-- Logs begin at Thu 2021-12-16 13:49:09 UTC, end at Thu 2021-12-16 15:05:07 UTC. -- Dec 16 14:28:35.475296 dv-cinder-821893-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 14:28:35.483676 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 14:28:35 2021] *** Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: nodename: dv-cinder-821893-3-iscsi Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: machine: x86_64 Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: clock source: unix Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: pcre jit disabled Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: detected number of CPU cores: 4 Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: current working directory: / Dec 16 14:28:35.485823 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: detected binary path: /usr/bin/uwsgi-core Dec 16 14:28:35.486473 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: your processes number limit is 47680 Dec 16 14:28:35.486473 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: your memory page size is 4096 bytes Dec 16 14:28:35.486473 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: detected max file descriptor number: 2048 Dec 16 14:28:35.486473 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: lock engine: pthread robust mutexes Dec 16 14:28:35.487798 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: thunder lock: enabled Dec 16 14:28:35.487798 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 14:28:35.487798 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 14:28:35.528109 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: Python main interpreter initialized at 0x564706c209c0 Dec 16 14:28:35.528109 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: python threads support enabled Dec 16 14:28:35.528109 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: your server socket listen backlog is limited to 100 connections Dec 16 14:28:35.528109 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: your mercy for graceful operations on workers is 90 seconds Dec 16 14:28:35.528762 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 14:28:35.528762 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: *** Operational MODE: preforking *** Dec 16 14:28:35.528958 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: *** uWSGI is running in multiple interpreter mode *** Dec 16 14:28:35.528958 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: spawned uWSGI master process (pid: 82175) Dec 16 14:28:35.529061 dv-cinder-821893-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 14:28:35.532983 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: spawned uWSGI worker 1 (pid: 82176, cores: 1) Dec 16 14:28:35.532983 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: spawned uWSGI worker 2 (pid: 82177, cores: 1) Dec 16 14:28:35.532983 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 14:28:39.753812 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:28:39.754466 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:28:39.754576 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:28:39.754897 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:28:39.755144 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:28:39.755547 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.755857 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.756186 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.756555 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.756886 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.757197 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.757529 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.757842 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.758223 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.758586 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.758946 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.759216 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.759531 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.759846 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821893-3-iscsi {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.760169 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.760469 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.760792 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.761116 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.761420 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.761752 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.762090 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.762560 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.763004 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.763306 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.763612 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.763950 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.764453 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.764765 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.764936 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.765198 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.765587 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.765892 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.766366 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821893-3-iscsi {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.766771 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.767089 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.767555 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.767967 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.768283 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.768600 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.768952 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.769249 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.769620 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.769944 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.770403 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.770660 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.770962 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.771281 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.771560 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.771906 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.772184 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.772519 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.772800 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.773130 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.773364 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.773687 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.774023 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.774349 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.774599 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.774837 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.775150 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.775579 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.775892 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.776063 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.776370 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.776725 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.777004 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.777305 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.777602 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.777902 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.778133 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:28:39.778739 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.778963 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:28:39.779135 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.779135 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.779437 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:28:39.779518 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.779653 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:28:39.779746 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.779819 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:28:39.779901 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.780032 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.780142 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.780391 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.780539 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.780747 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.780876 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.781040 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.781141 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.781344 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.781446 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.781656 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.781751 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.782428 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.782544 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.782751 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.782983 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.783086 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.783366 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.783482 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.783714 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.783819 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.783990 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.784166 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.784357 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.784449 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.784586 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.784878 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.785027 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.785175 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.785259 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821893-3-iscsi {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.785460 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.785592 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.785759 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.785853 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.786081 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.786179 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.786387 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.786484 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.786678 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.786782 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.787025 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.787126 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.787273 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.787373 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.787575 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.787854 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.787972 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.788163 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.788336 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.788454 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.788542 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.791434 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.791538 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.791620 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.791708 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.791787 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.791864 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.791950 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792029 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792105 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792182 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792259 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792335 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792419 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792498 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792581 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792665 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792741 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792817 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821893-3-iscsi {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.792983 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793065 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793141 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793226 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793304 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793396 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793475 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793559 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793643 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793727 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793817 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793901 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.793978 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794096 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794175 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794264 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794346 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794429 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794506 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794506 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794710 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794804 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794889 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.794973 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.795099 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.795211 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.795296 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.795425 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.795524 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.795729 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.795875 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.796036 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.796342 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.796441 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.796658 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.796756 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.796952 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.797047 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.797652 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.797955 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.798122 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.798424 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.798559 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.798750 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.798999 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.799087 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.799369 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.799462 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.799662 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.799754 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.799972 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.800091 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.800316 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.800404 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.800589 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.800687 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.800941 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.801037 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.801280 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.801394 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.801613 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.801712 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.801936 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.802083 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.802287 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.802387 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.802594 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.802700 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.802954 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.803053 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.803273 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.803396 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.803539 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.803684 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.803844 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.803993 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.804206 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.804340 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.804473 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.804748 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.804842 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.805112 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.805257 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.805419 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.805578 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.805728 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.805886 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.806067 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.806395 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.806569 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.806703 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.806849 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.806941 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.807058 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.807254 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.807363 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.807610 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.807727 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.807941 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.808126 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.808279 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.808569 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.808664 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.808887 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.808978 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.809196 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.809281 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.809510 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.809609 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.809826 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.810029 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.810141 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.810365 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.810509 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.810738 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.810852 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.811047 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.811173 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.811383 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.811496 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.811696 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.811842 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.812016 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.812172 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.812294 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.812489 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.812586 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.812887 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.813113 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.813267 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.813412 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.813563 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.813923 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.814040 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.814379 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.814491 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.814688 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.814842 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.814997 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.815114 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.815336 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.815478 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.815596 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.815800 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.815928 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.816186 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.816311 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.816497 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.816614 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.816803 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.816889 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.817101 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.817203 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.817404 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.817516 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.817722 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.817832 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.818043 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.818141 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.818365 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.818569 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.818711 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.818893 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.818989 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.819202 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.819309 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.819508 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.819600 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.819840 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.820096 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.820257 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.820394 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.820506 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.820600 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.820753 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.821023 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.821126 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.821334 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.821489 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.821649 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.821791 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.821983 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.822154 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.822369 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.822588 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.822733 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.822903 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.823036 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.823210 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.823317 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.823518 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.823622 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.823823 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.823955 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.824146 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.824262 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.824414 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.824626 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.824778 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.824961 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.825063 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.825270 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.825364 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.825567 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.825694 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.825864 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.826046 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.826197 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.826325 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.826684 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.826842 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.826998 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.827139 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.827263 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.827405 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.827548 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.827662 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.827731 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.827822 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.827966 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.828125 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.828304 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.828550 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.828685 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.828886 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.829031 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.829300 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.829481 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:28:39.829692 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.829937 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.830115 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.830285 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.830369 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.830615 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.830879 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.831029 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.831118 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.831229 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.831455 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.831544 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.831771 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.831911 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.832089 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.832218 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.832394 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.832530 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.832718 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.832936 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.833042 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.833203 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.833321 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.833608 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.833710 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.833916 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.834096 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.834310 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.834478 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.834569 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.834879 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.834983 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.835182 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.835273 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.835501 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.835704 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.835924 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.836084 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.836225 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.836411 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.836501 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.836683 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.836883 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.837106 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.837301 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.837447 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.837550 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.837725 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.837862 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.838065 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.838224 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.838359 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.838528 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.838672 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.838822 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.838918 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.839066 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.839286 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.839431 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.839606 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.839802 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.840012 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.840175 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.840328 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.840328 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.840686 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.840825 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.840974 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.841143 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.841372 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.841537 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.841537 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.841778 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.841970 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.842163 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.842264 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.842352 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.842466 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.842552 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.842681 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.842816 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.842989 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.843158 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.843287 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.843490 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.843643 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.843784 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.843941 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.844137 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.844435 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.844566 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.844774 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.845060 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.845165 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.845403 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.845500 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.845731 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.845922 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.846067 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.846315 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.846445 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.846642 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.846741 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.846951 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.847127 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.847240 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.847441 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.847530 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.847755 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.847849 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.848078 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.848246 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.848379 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.848471 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.848711 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.848857 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.849006 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.849225 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.849366 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.849472 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.849620 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.849775 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.849920 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.850098 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.850240 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.850439 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.850535 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.850835 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.850967 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.851148 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.851237 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.851455 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.851549 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.851756 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.851855 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.852066 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.852175 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.852382 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.852488 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.852673 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.852784 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.852979 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.853136 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.853289 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.853459 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.853594 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.853880 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.853974 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.854219 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.854379 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.854518 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.854692 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.854854 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.855054 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.855151 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.855382 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.855687 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.855822 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.856021 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.856186 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.856326 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.856459 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.856644 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.856751 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.856964 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.857169 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.857307 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.857595 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.857732 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.857913 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.858053 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.858240 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.858329 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.858545 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.858655 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.858847 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.858969 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.859147 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.859295 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.859443 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.859659 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.859759 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.860031 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.860166 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.860464 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.860597 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.860885 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.861025 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.861342 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.861440 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.861678 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.861829 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.862062 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.862183 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.862373 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.862538 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.862677 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.862826 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.862979 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.863145 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.863287 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.863472 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.863599 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.863780 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.863922 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.864101 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.864235 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.864403 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.864533 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.864706 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.864854 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.864997 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.865120 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.865294 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.865436 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.865610 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.865743 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.865911 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.866187 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.866321 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.866454 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.866591 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.866721 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.866858 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.866979 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.867190 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.867339 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.867466 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.867603 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.867777 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.867916 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.868073 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.868250 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.868381 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.868513 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.868658 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.868745 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.868964 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.869090 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.869264 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.869370 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.869571 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.869809 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.869921 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.870039 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.870195 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.870303 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.870492 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.870673 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.870802 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.871024 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.871155 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.871329 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.871460 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.871654 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.871803 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.871942 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.872194 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.872325 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.872468 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.872623 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.872796 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.872962 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.873121 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.873258 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.873400 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.873540 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.873678 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.873814 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.873963 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.874169 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.874310 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.874447 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.874605 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.874741 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.874895 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.875039 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.875177 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.875313 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.875447 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.875728 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.875872 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.876053 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.876210 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.876387 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.876597 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.876798 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.876942 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.877107 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.877250 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.877402 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.877563 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.877708 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.878023 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.878172 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.878320 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.878438 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.878618 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.878796 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.878896 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.879105 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.879196 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.879428 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.879592 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.879723 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.879807 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.880062 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.880160 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.880361 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.880577 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.880710 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.880831 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.880978 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.881153 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.881274 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.881471 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.881627 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.881925 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.882107 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.882269 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.882396 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.882580 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.882691 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.882882 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.882977 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.883179 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.883282 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.883491 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.883658 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.883789 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.884096 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.884301 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.884458 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.884611 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.884783 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.884989 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.885196 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.885382 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.885570 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.885772 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.885982 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.886199 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.886398 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.886398 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.886740 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.886931 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.887076 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.887257 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.887469 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.887641 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.887799 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.887950 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.888214 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.888401 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.888571 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.888769 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.888769 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.889087 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.889183 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.889443 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.889614 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.889820 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.890025 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.890025 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.890413 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.890588 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.890772 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.890970 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.891189 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.891369 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.891522 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.891690 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.891785 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892006 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892006 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892242 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892242 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892399 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892399 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892635 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892734 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892846 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.892930 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.893044 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.893128 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.893332 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.893448 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.893799 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.894130 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.894225 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.894442 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.894555 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.894748 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.894874 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.895055 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.895145 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.895361 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.895543 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.895700 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.895934 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.896032 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.896257 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.896356 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.896584 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.896710 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.896909 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.897014 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.897260 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.897390 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.897563 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.897655 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.897865 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.897962 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.898210 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.898336 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.898522 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.898712 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.898830 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.899011 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.899162 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.899318 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.899420 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.899735 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.899831 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.900046 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.900149 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.901108 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.901256 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.901380 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.901471 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.901471 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.901643 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.901731 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.901879 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.901879 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.902141 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.902141 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.902369 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.902369 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.902539 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.902631 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.902767 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.902954 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.903043 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.903202 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.903313 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.903595 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.903711 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.903838 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.903979 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.904177 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.904335 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.904483 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.904785 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.904942 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.905089 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.905220 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.905413 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.905500 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.905719 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.905816 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.906071 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.906193 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.906368 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.906583 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.906685 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.907071 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.907207 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.907412 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.907621 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.907975 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.908070 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.908364 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.908556 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.908723 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.908861 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.909032 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.909197 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.909353 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.909599 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.909726 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.910025 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.910141 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.910315 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.910460 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.910607 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.910767 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.910909 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.911079 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.911211 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.911518 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.911639 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.911824 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.911948 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.912128 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.912224 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.912432 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.912526 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.912744 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.912864 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.913051 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.913197 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.913329 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.913499 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.913709 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.913809 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.913944 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.914121 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.914269 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.914451 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.914599 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.914888 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.915002 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.915204 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.915306 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.915515 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.915638 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.915816 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.915969 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.916172 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.916290 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.916479 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.916612 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.916787 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.916976 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.917086 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.917370 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.917472 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.917708 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.917806 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.918059 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.918207 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.918343 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.918507 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.918664 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.918869 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.919040 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.919176 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.919378 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.919559 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.919709 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.919843 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.919946 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.920109 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.920279 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.920486 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.920698 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.920840 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.920943 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.921150 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.921292 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.921423 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.921515 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.921712 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.921868 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.922036 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.922540 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.922712 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.922988 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.923180 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.923330 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.923463 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.923637 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.924014 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.924154 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.924318 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.924438 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.924651 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.924818 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.924961 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.925141 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.925308 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.925515 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.925679 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.925814 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.926112 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.926201 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.926466 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.926553 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.926818 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.926907 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.927122 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.927360 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.927438 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.927752 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.927827 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.928071 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.928211 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.928391 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.928705 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.928796 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.929007 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.929200 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.929317 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.929556 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.929661 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.930024 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.930106 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.930325 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.930486 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.930635 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.930814 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.930946 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.931142 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.931254 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.931477 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.931584 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.931792 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.931875 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.932104 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.932180 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.932438 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.932522 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.932908 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.933013 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.933222 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.933336 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.933592 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.933681 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.933918 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.934020 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.934308 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.934413 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.934620 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.934699 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.934933 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.935068 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.935240 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.935418 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.935545 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.935701 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.935858 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.935990 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.936129 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.936434 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.936549 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.936778 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.936984 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.937217 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.937437 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.937593 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.937699 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.937783 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.938144 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.938254 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.938641 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.938880 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.939106 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.939296 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.939506 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.939691 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.939830 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.940028 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.940188 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.940324 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.940483 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.940634 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.940793 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.940953 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.941317 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.941435 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.941598 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.941720 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.941886 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.942064 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.942217 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.942305 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.942533 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.942630 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.942847 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.942992 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.943150 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.943248 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.943459 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.943624 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.943783 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.944020 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.944129 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.944406 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.944585 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.944703 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.944817 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.945070 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.945237 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.945378 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.945517 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.945660 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.945792 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.945935 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.946155 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.946266 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.946472 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.946760 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.946854 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.947111 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.947293 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.947429 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.947741 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.947852 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.948052 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.948368 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.948467 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.948665 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.948973 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.949137 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.949286 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.949561 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.949757 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.949905 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.950085 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.950239 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.950545 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.950646 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.950845 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.951160 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.951247 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.951461 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.951559 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.951807 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.951997 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.952170 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.952348 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.952527 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.952658 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.952857 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.952978 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.953206 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.953292 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.953531 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.953669 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.953955 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.954096 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.954308 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.954579 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.954693 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.954914 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.955035 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.955291 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.955396 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.955545 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.955689 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.955844 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.956012 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.956146 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.956323 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.956451 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.956650 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.956740 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.957011 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.957108 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.957342 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.957449 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.957640 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.957815 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.957969 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.958293 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.958580 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.958687 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.958877 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.959044 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.959263 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.959353 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.959479 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.959711 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.959801 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.960030 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.960268 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.960371 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.960621 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.960786 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.960915 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.961234 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.961382 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.961547 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.961791 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.961890 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.962142 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.962235 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.962453 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.962557 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.962751 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.962840 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.963070 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.963158 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.963397 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.963499 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.963673 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.963814 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.963988 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.964150 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.964293 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.964554 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.964742 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.964911 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.965066 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.965293 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.965467 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.965585 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.965719 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.965962 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.966173 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.966398 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.966796 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.966957 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.967105 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.967234 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.967427 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.967629 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.967805 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.967908 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.968103 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.968355 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.968466 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.968706 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.968837 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.969070 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.969445 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.969622 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.969718 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.969899 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.970190 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.970386 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.970525 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.970625 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.970815 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.971039 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.971211 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.971404 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.971526 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.971743 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.971919 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.972059 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.972213 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.972537 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.972753 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.972885 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.973018 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.973143 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.973321 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.973478 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.973668 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.973848 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.974042 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.974224 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.974365 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.974503 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.974826 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.975050 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.975142 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.975287 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.975418 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.975575 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.975782 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.975910 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.976078 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.976175 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.976337 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.976576 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.976669 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.976887 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.976984 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.977231 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.977320 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.977489 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.977863 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.977973 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.978229 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.978365 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.978546 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.978679 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.978864 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.979014 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.979173 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.979309 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.979483 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.979729 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.979819 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.980063 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.980252 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.980436 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.980654 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.980736 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.980860 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.981015 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.981281 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.981380 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.981643 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.981744 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.981930 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.982034 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.982286 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.982392 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.982600 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.982712 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.982906 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.983008 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.983227 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.983334 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.983548 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.983688 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.983847 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.984006 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.984168 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.984342 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.984478 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.984755 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.984896 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.985105 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.985273 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.985442 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.985612 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.985751 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.986127 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.986293 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.986443 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.986561 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.986722 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.986971 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.987094 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.987286 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.987481 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.987646 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.987945 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.988116 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.988219 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.988304 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.988555 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.988686 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.988877 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.989008 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.989191 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.989348 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.989530 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.989766 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.989903 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.990059 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.990218 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.990431 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.990571 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.990712 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.990845 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.990990 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.991132 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.991258 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.991380 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.991502 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.991638 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.991782 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.991917 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.992060 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.992233 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.992374 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.992553 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.992752 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.992896 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.993020 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.993207 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.993343 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.993511 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.993785 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.993934 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.994165 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.994312 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.994451 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:28:39.994620 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.994797 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.995105 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.995423 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.995744 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.996060 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.996372 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.996691 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.997000 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.997314 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.997626 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.997958 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.998495 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.999004 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.999420 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:39.999937 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.000409 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.000838 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.001359 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.001911 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.002544 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.002860 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.003198 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.003524 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.004034 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.004312 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.004759 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.005119 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.005562 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.005876 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.006239 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.006552 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.006854 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.007301 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.007610 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.007974 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.008373 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.008692 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.009259 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.009672 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.009999 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.010340 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.010784 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.011228 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.011597 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.011936 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.012366 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.012847 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.013456 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.013839 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.013946 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.014367 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.014562 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.014883 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.015295 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.015617 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.016055 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.016583 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.017049 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.017550 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.017870 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.018354 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.018670 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.019122 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.019463 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.019875 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.020197 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.020637 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.021035 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.021600 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.021927 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.022288 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.022601 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.023030 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.023312 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.023753 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.024092 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.024427 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.024760 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.025188 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.025633 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.025964 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.026370 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.026823 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.027457 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.027900 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.028235 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.028635 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.028986 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.029413 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.029733 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.030072 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.030407 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.030718 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.031035 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.031386 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.031698 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.032374 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_db.sqlalchemy.engines [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:28:40.032635 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.033041 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.033414 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.033831 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.034191 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.034562 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.034916 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.035240 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.035565 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.035880 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.037472 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.037472 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.037472 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.037472 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.038396 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.038396 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.038699 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.039050 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.039365 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.039799 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.040139 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.040446 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.040857 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.041225 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.041573 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.041937 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.042291 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.042617 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.042926 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.043232 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.043537 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.043841 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.044182 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.044495 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.044821 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.045136 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.045457 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.045765 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.046108 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.046436 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.046760 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.047066 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.048191 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.048738 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.049074 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.049530 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.049848 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.050235 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.050674 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.051023 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.051358 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.051670 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.052162 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.052488 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.052816 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.053135 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.053620 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.053954 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.054315 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.054786 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.055119 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.055437 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.055785 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.056425 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.056790 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.057301 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.057637 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.058156 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.058546 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.058864 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.059336 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.059701 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:28:40.060076 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:28:40.102387 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG oslo_db.sqlalchemy.engines [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:28:40.284709 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.context [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d4c520e-4808-4be1-897a-302246289de2(cell1) {{(pid=82177) load_cells /opt/stack/nova/nova/context.py:465}} Dec 16 14:28:40.288975 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:28:40.290670 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:28:40.291443 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:28:40.293414 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:28:40.321295 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_db.sqlalchemy.engines [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:28:40.322438 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_db.sqlalchemy.engines [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:28:40.356804 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_db.sqlalchemy.engines [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:28:40.367567 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.context [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d4c520e-4808-4be1-897a-302246289de2(cell1) {{(pid=82176) load_cells /opt/stack/nova/nova/context.py:465}} Dec 16 14:28:40.372037 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG oslo_concurrency.lockutils [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:28:40.373776 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG oslo_concurrency.lockutils [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:28:40.374741 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG oslo_concurrency.lockutils [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:28:40.377040 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG oslo_concurrency.lockutils [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:28:40.409181 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG oslo_db.sqlalchemy.engines [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:28:40.410013 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG oslo_db.sqlalchemy.engines [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:28:40.444201 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG oslo_db.sqlalchemy.engines [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:28:40.535414 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO keyring.backend [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Loading KWallet Dec 16 14:28:40.545112 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO keyring.backend [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Loading SecretService Dec 16 14:28:40.549860 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO keyring.backend [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Loading Windows Dec 16 14:28:40.551767 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO keyring.backend [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Loading chainer Dec 16 14:28:40.552545 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO keyring.backend [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Loading macOS Dec 16 14:28:40.591770 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO keyring.backend [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Loading KWallet Dec 16 14:28:40.602225 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO keyring.backend [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Loading SecretService Dec 16 14:28:40.606713 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO keyring.backend [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Loading Windows Dec 16 14:28:40.608698 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO keyring.backend [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Loading chainer Dec 16 14:28:40.609545 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO keyring.backend [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Loading macOS Dec 16 14:28:40.909121 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: WARNING keystonemiddleware.auth_token [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:28:40.916048 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: WARNING keystonemiddleware.auth_token [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:28:40.967174 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: WARNING keystonemiddleware.auth_token [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:28:40.974162 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: WARNING keystonemiddleware.auth_token [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:28:41.127172 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: WARNING keystonemiddleware.auth_token [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:28:41.132568 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: WARNING keystonemiddleware.auth_token [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:28:41.137872 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564706c209c0 pid: 82177 (default app) Dec 16 14:28:41.140051 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:28:41.141240 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-2d46ffbd-6e1c-4c27-89dd-b5be80ee012a None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Dec 16 14:28:41.142177 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Thu Dec 16 14:28:41 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:28:41.187534 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: WARNING keystonemiddleware.auth_token [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:28:41.193134 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: WARNING keystonemiddleware.auth_token [None req-5382165b-0d91-47fa-be9f-18efbfa8e492 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:28:41.198561 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564706c209c0 pid: 82176 (default app) Dec 16 14:30:05.007006 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-7894e780-311b-46d8-beab-66b738b5e479 admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:05.032470 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-7894e780-311b-46d8-beab-66b738b5e479 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.497618 Dec 16 14:30:05.033023 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 2/2] 10.222.0.67 () {58 vars in 1159 bytes} [Thu Dec 16 14:30:04 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:30:07.587108 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-9097c238-015c-4244-bf8b-1f3c5f0272b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:07.611423 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:30:07.611423 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: warnings.warn(msg) Dec 16 14:30:07.646292 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-9097c238-015c-4244-bf8b-1f3c5f0272b2 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.397794 Dec 16 14:30:07.647133 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 1/3] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:07 2021] POST /compute/v2.1/flavors => generated 367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:07.664330 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-9cdde0c2-222c-415e-98cd-1ae9f9caa4ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:07.671607 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:30:07.671607 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: warnings.warn(msg) Dec 16 14:30:07.715363 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-9cdde0c2-222c-415e-98cd-1ae9f9caa4ea admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.060585 Dec 16 14:30:07.716113 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 3/4] 10.222.0.67 () {62 vars in 1245 bytes} [Thu Dec 16 14:30:07 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:07.733043 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-44282374-b307-4659-a641-84f9d3bee925 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:07.758709 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-44282374-b307-4659-a641-84f9d3bee925 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.035645 Dec 16 14:30:07.759284 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 2/5] 10.222.0.67 () {58 vars in 1192 bytes} [Thu Dec 16 14:30:07 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:10.048945 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-85358083-e245-43b2-975a-8316aeab5a54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:10.072976 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:30:10.072976 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: warnings.warn(msg) Dec 16 14:30:10.100878 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-85358083-e245-43b2-975a-8316aeab5a54 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.136835 Dec 16 14:30:10.101491 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 4/6] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:09 2021] POST /compute/v2.1/flavors => generated 364 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:10.118043 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-e50c94cb-dc03-47ff-b0ca-4496cd4db5b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:10.124406 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:30:10.124406 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: warnings.warn(msg) Dec 16 14:30:10.169168 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-e50c94cb-dc03-47ff-b0ca-4496cd4db5b9 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.060730 Dec 16 14:30:10.169785 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 3/7] 10.222.0.67 () {62 vars in 1245 bytes} [Thu Dec 16 14:30:10 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:10.185828 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-f7e9ebc0-8f1a-4afe-bf32-c2a2f6a843a9 admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:10.331841 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-f7e9ebc0-8f1a-4afe-bf32-c2a2f6a843a9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.155431 Dec 16 14:30:10.332656 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 5/8] 10.222.0.67 () {58 vars in 1192 bytes} [Thu Dec 16 14:30:10 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:12.565360 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-1b875098-0751-44f8-8479-ec2252dc6b4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:12.594785 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-1b875098-0751-44f8-8479-ec2252dc6b4a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.113660 Dec 16 14:30:12.595392 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 4/9] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:12 2021] POST /compute/v2.1/flavors => generated 364 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:12.611525 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-f33ef0ab-ea04-4049-9af3-7a3792108647 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:12.655388 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-f33ef0ab-ea04-4049-9af3-7a3792108647 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.052359 Dec 16 14:30:12.655993 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 6/10] 10.222.0.67 () {62 vars in 1245 bytes} [Thu Dec 16 14:30:12 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:12.670695 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-ce087b13-6fbd-4479-a8a0-a092642c52df admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:12.692390 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-ce087b13-6fbd-4479-a8a0-a092642c52df admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030242 Dec 16 14:30:12.692992 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 5/11] 10.222.0.67 () {58 vars in 1192 bytes} [Thu Dec 16 14:30:12 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:15.042196 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-904c6c8b-080e-48da-a45d-0b21946ccc2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:15.070979 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-904c6c8b-080e-48da-a45d-0b21946ccc2d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.120778 Dec 16 14:30:15.071566 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 7/12] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:14 2021] POST /compute/v2.1/flavors => generated 364 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:15.086849 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-bc7991b5-ad23-4c6c-b9b4-a1a3ae462cd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:15.251679 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-bc7991b5-ad23-4c6c-b9b4-a1a3ae462cd2 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.173397 Dec 16 14:30:15.252174 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 6/13] 10.222.0.67 () {62 vars in 1245 bytes} [Thu Dec 16 14:30:15 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:15.267116 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-7172dab2-367b-49f7-993a-44ab8df11038 admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:15.288010 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-7172dab2-367b-49f7-993a-44ab8df11038 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029352 Dec 16 14:30:15.288820 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 8/14] 10.222.0.67 () {58 vars in 1192 bytes} [Thu Dec 16 14:30:15 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:17.528811 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-87e1259b-6ba6-4477-b399-586e7063076f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:17.558898 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-87e1259b-6ba6-4477-b399-586e7063076f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.115019 Dec 16 14:30:17.559554 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 7/15] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:17 2021] POST /compute/v2.1/flavors => generated 364 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:17.575615 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-fc286a70-8a9f-49ad-a94c-0f14360664ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:17.623017 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-fc286a70-8a9f-49ad-a94c-0f14360664ab admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.056388 Dec 16 14:30:17.623642 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 9/16] 10.222.0.67 () {62 vars in 1245 bytes} [Thu Dec 16 14:30:17 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:17.638286 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-32e0414b-6b66-44c1-9df2-3a75101f74af admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:17.658339 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-32e0414b-6b66-44c1-9df2-3a75101f74af admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028541 Dec 16 14:30:17.658925 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 8/17] 10.222.0.67 () {58 vars in 1192 bytes} [Thu Dec 16 14:30:17 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:19.916442 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-e3009150-f9c8-4d49-a657-bf43f5010741 admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:19.935603 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-e3009150-f9c8-4d49-a657-bf43f5010741 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.102829 Dec 16 14:30:19.936224 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 10/18] 10.222.0.67 () {58 vars in 1159 bytes} [Thu Dec 16 14:30:19 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:30:22.145406 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-c4209f6b-db73-431f-8626-c87477bd9f6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:22.174986 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-c4209f6b-db73-431f-8626-c87477bd9f6f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.128991 Dec 16 14:30:22.175518 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 9/19] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:22 2021] POST /compute/v2.1/flavors => generated 362 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:22.191242 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-7f8f90b9-ac2d-4beb-9e66-8ce34dfe19ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:22.232914 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-7f8f90b9-ac2d-4beb-9e66-8ce34dfe19ca admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050209 Dec 16 14:30:22.233511 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 11/20] 10.222.0.67 () {62 vars in 1242 bytes} [Thu Dec 16 14:30:22 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:22.247849 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-5d6ea5d3-da6f-42fb-9412-0693ddd8f5c1 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:22.267294 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-5d6ea5d3-da6f-42fb-9412-0693ddd8f5c1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027905 Dec 16 14:30:22.267831 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 10/21] 10.222.0.67 () {58 vars in 1189 bytes} [Thu Dec 16 14:30:22 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:24.459674 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-100c4a58-fa2e-48bd-bef3-8de9abebe0bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:24.489791 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-100c4a58-fa2e-48bd-bef3-8de9abebe0bb admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.119300 Dec 16 14:30:24.490408 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 12/22] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:24 2021] POST /compute/v2.1/flavors => generated 365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:24.505939 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-3a5a2beb-7be8-4a34-9266-5256f5f6e329 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:24.556002 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-3a5a2beb-7be8-4a34-9266-5256f5f6e329 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.058408 Dec 16 14:30:24.556567 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 11/23] 10.222.0.67 () {62 vars in 1242 bytes} [Thu Dec 16 14:30:24 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:24.573674 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-59535ee4-c0dd-4071-a21e-526a59417be9 admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:24.593854 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-59535ee4-c0dd-4071-a21e-526a59417be9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029155 Dec 16 14:30:24.594486 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 13/24] 10.222.0.67 () {58 vars in 1189 bytes} [Thu Dec 16 14:30:24 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:26.828991 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-9652ec73-9291-44fa-9e5c-b322138e9ec5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:26.860921 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-9652ec73-9291-44fa-9e5c-b322138e9ec5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.119280 Dec 16 14:30:26.861460 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 12/25] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:26 2021] POST /compute/v2.1/flavors => generated 366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:26.878294 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-83f7e7de-0266-4920-b6d4-1c1452f60a46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:26.925395 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-83f7e7de-0266-4920-b6d4-1c1452f60a46 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.056241 Dec 16 14:30:26.926015 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 14/26] 10.222.0.67 () {62 vars in 1242 bytes} [Thu Dec 16 14:30:26 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:30:26.940960 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-fa56e2d7-bfa7-4b1a-b105-332a0ca57b10 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:26.962310 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-fa56e2d7-bfa7-4b1a-b105-332a0ca57b10 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029728 Dec 16 14:30:26.962858 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 13/27] 10.222.0.67 () {58 vars in 1189 bytes} [Thu Dec 16 14:30:26 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:29.396823 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-04b10b90-085c-4613-8bdc-00b45dbfe9b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:29.449036 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-04b10b90-085c-4613-8bdc-00b45dbfe9b6 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.166563 Dec 16 14:30:29.449904 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 15/28] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:29 2021] POST /compute/v2.1/flavors => generated 365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:30:29.466853 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-0c79eda4-856b-46bb-b5f8-b1712004f498 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:29.513549 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-0c79eda4-856b-46bb-b5f8-b1712004f498 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.057051 Dec 16 14:30:29.514283 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 14/29] 10.222.0.67 () {62 vars in 1242 bytes} [Thu Dec 16 14:30:29 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:30:29.532064 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-f66a9f84-28c3-44f1-bd6b-4629521ae48b admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:29.551548 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-f66a9f84-28c3-44f1-bd6b-4629521ae48b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029212 Dec 16 14:30:29.552110 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 16/30] 10.222.0.67 () {58 vars in 1189 bytes} [Thu Dec 16 14:30:29 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:32.269423 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-e89ba9f5-6967-410f-a8c9-76daa5bbf6f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:32.300063 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-e89ba9f5-6967-410f-a8c9-76daa5bbf6f6 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.119243 Dec 16 14:30:32.300527 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 15/31] 10.222.0.67 () {62 vars in 1192 bytes} [Thu Dec 16 14:30:32 2021] POST /compute/v2.1/flavors => generated 368 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:32.317701 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-a8412428-3678-4cd1-9a14-c581350d4e56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:30:32.365496 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-a8412428-3678-4cd1-9a14-c581350d4e56 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.057204 Dec 16 14:30:32.366130 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 17/32] 10.222.0.67 () {62 vars in 1242 bytes} [Thu Dec 16 14:30:32 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:30:32.383326 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-dc24285a-765a-43f6-9359-b1017be8388d admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:32.403461 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-dc24285a-765a-43f6-9359-b1017be8388d admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030555 Dec 16 14:30:32.404032 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 16/33] 10.222.0.67 () {58 vars in 1189 bytes} [Thu Dec 16 14:30:32 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:31:43.187000 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-a4056434-702f-4724-831d-d0f5cc80267f admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:43.208767 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-a4056434-702f-4724-831d-d0f5cc80267f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.104308 Dec 16 14:31:43.209339 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 18/34] 10.222.0.67 () {58 vars in 1159 bytes} [Thu Dec 16 14:31:43 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:31:44.639349 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-dc24285a-765a-43f6-9359-b1017be8388d admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:44.640384 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-dc24285a-765a-43f6-9359-b1017be8388d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Dec 16 14:31:44.640789 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 17/35] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:31:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:44.864764 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-307a9b9c-cb60-4ac6-9077-9283a7139db7 admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:44.878366 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.wsgi [None req-307a9b9c-cb60-4ac6-9077-9283a7139db7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 14:31:44.878958 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-307a9b9c-cb60-4ac6-9077-9283a7139db7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=82177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:31:44.879767 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-307a9b9c-cb60-4ac6-9077-9283a7139db7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.102534 Dec 16 14:31:44.880323 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 19/36] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Dec 16 14:31:44 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 16 14:31:44.897492 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-0e7b11d9-b36a-464f-a249-ca990411d3d7 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:44.921123 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-0e7b11d9-b36a-464f-a249-ca990411d3d7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.032383 Dec 16 14:31:44.921728 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Dec 16 14:31:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:31:44.937278 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-eeafa87f-f8a6-4668-960d-0cce3ef39bcf admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:44.961425 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-eeafa87f-f8a6-4668-960d-0cce3ef39bcf admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.030559 Dec 16 14:31:44.962056 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 20/38] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Dec 16 14:31:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:31:44.977410 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-65330c10-0b40-4012-beea-9641176716be admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:44.990608 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.wsgi [None req-65330c10-0b40-4012-beea-9641176716be admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 14:31:44.991189 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-65330c10-0b40-4012-beea-9641176716be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=82176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:31:44.991994 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-65330c10-0b40-4012-beea-9641176716be admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.023306 Dec 16 14:31:44.992546 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Dec 16 14:31:44 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:46.390288 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-eeafa87f-f8a6-4668-960d-0cce3ef39bcf admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:46.391340 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-eeafa87f-f8a6-4668-960d-0cce3ef39bcf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Dec 16 14:31:46.391786 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 21/40] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:31:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:31:46.616830 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-3aeadcf1-f0d7-4651-a0b3-12df3055d59a admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:46.630523 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.wsgi [None req-3aeadcf1-f0d7-4651-a0b3-12df3055d59a admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 14:31:46.631090 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-3aeadcf1-f0d7-4651-a0b3-12df3055d59a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=82176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:31:46.631907 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-3aeadcf1-f0d7-4651-a0b3-12df3055d59a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.101505 Dec 16 14:31:46.632457 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Dec 16 14:31:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:46.646834 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-4c41d7b4-3d28-4124-885a-6b774bb608da admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:46.667429 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-4c41d7b4-3d28-4124-885a-6b774bb608da admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028938 Dec 16 14:31:46.667991 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Dec 16 14:31:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:31:46.683331 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-70ff2351-ada3-48ae-adb6-99934d878c89 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:46.705501 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-70ff2351-ada3-48ae-adb6-99934d878c89 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.030661 Dec 16 14:31:46.706092 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 21/43] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Dec 16 14:31:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:31:46.721046 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-f9728258-3b63-463f-a861-0e6db6cdcfa7 admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:46.733859 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.wsgi [None req-f9728258-3b63-463f-a861-0e6db6cdcfa7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 14:31:46.734434 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-f9728258-3b63-463f-a861-0e6db6cdcfa7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=82177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:31:46.735222 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-f9728258-3b63-463f-a861-0e6db6cdcfa7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.022903 Dec 16 14:31:46.735790 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Dec 16 14:31:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:48.131430 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-70ff2351-ada3-48ae-adb6-99934d878c89 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:48.133040 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-70ff2351-ada3-48ae-adb6-99934d878c89 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Dec 16 14:31:48.133040 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 22/45] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:31:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:48.357799 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-736e7185-8f79-45e2-83db-8cb80d608ca0 admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:48.371032 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.wsgi [None req-736e7185-8f79-45e2-83db-8cb80d608ca0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 14:31:48.371760 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-736e7185-8f79-45e2-83db-8cb80d608ca0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=82177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:31:48.372568 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-736e7185-8f79-45e2-83db-8cb80d608ca0 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.102009 Dec 16 14:31:48.373091 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Dec 16 14:31:48 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 16 14:31:48.389341 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-b4feeaf1-e28a-4ebe-af01-df679985c16a admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:48.410622 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-b4feeaf1-e28a-4ebe-af01-df679985c16a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.029800 Dec 16 14:31:48.411191 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Dec 16 14:31:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:31:48.429590 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:48.458208 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.039889 Dec 16 14:31:48.458795 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 25/48] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Dec 16 14:31:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:31:48.475074 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-fe085810-6087-4555-8b65-e60873189142 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:48.488644 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.wsgi [None req-fe085810-6087-4555-8b65-e60873189142 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 14:31:48.489258 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-fe085810-6087-4555-8b65-e60873189142 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=82176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:31:48.490107 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-fe085810-6087-4555-8b65-e60873189142 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.023839 Dec 16 14:31:48.490653 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Dec 16 14:31:48 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:49.872264 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:49.873309 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Dec 16 14:31:49.873749 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 26/50] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:31:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:50.095036 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-a13dd68c-acc9-4f3b-a500-70421c72d218 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:50.131107 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-a13dd68c-acc9-4f3b-a500-70421c72d218 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.120208 Dec 16 14:31:50.131972 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 25/51] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Dec 16 14:31:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:31:51.549871 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:51.550903 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Dec 16 14:31:51.551301 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 27/52] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:31:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:51.772436 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-71dbac1a-4a34-484a-948f-1c311cfc61b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:51.807366 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-71dbac1a-4a34-484a-948f-1c311cfc61b5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.119769 Dec 16 14:31:51.808005 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 26/53] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Dec 16 14:31:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:31:53.202919 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:53.203683 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Dec 16 14:31:53.204002 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 28/54] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:31:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:31:53.431807 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-29846457-142a-4898-bad5-bba48c92225a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:53.474072 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-29846457-142a-4898-bad5-bba48c92225a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.127332 Dec 16 14:31:53.474624 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 27/55] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Dec 16 14:31:53 2021] POST /compute/v2.1/flavors => generated 407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:31:54.874750 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:54.875793 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Dec 16 14:31:54.876195 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 29/56] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:31:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:55.103924 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-6bdfc98f-a560-462a-9d64-f8e62301cc2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:55.142901 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-6bdfc98f-a560-462a-9d64-f8e62301cc2c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.127971 Dec 16 14:31:55.143473 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 28/57] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Dec 16 14:31:55 2021] POST /compute/v2.1/flavors => generated 409 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:31:56.507392 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:56.508477 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Dec 16 14:31:56.508922 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 30/58] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:31:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:56.727056 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-704046ea-b878-4550-a1ea-121f305abb66 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:56.758930 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-704046ea-b878-4550-a1ea-121f305abb66 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.114590 Dec 16 14:31:56.759467 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 29/59] 10.222.0.67 () {60 vars in 1202 bytes} [Thu Dec 16 14:31:56 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:32:37.269559 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:37.270603 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-774e3060-5102-415f-8238-78695b1203bf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Dec 16 14:32:37.271005 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 31/60] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:32:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:32:37.498359 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:37.529881 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.119042 Dec 16 14:32:37.530493 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 30/61] 10.222.0.67 () {60 vars in 1202 bytes} [Thu Dec 16 14:32:37 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:34:02.574868 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-649ee240-21b5-410f-9164-c1fe517c05da tempest-verify_tempest_config-615895522 tempest-verify_tempest_config-615895522-project] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:34:02.581389 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-649ee240-21b5-410f-9164-c1fe517c05da tempest-verify_tempest_config-615895522 tempest-verify_tempest_config-615895522-project] 10.222.0.67 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.161030 Dec 16 14:34:02.581945 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 32/62] 10.222.0.67 () {58 vars in 1133 bytes} [Thu Dec 16 14:34:02 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:35:35.823086 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:35:35.824173 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Dec 16 14:35:35.824560 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 31/63] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:35:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:35:36.117115 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-f7667018-b684-4896-bcf2-8f1677948d7b admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:35:36.122911 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:35:36.122911 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: warnings.warn(msg) Dec 16 14:35:36.124498 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-f7667018-b684-4896-bcf2-8f1677948d7b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:35:36.124947 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-f7667018-b684-4896-bcf2-8f1677948d7b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:35:36.125913 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-f7667018-b684-4896-bcf2-8f1677948d7b admin admin] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:35:36.126367 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-f7667018-b684-4896-bcf2-8f1677948d7b admin admin] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:35:36.158647 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-f7667018-b684-4896-bcf2-8f1677948d7b admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.195192 Dec 16 14:35:36.159225 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Dec 16 14:35:35 2021] GET /compute/v2.1/os-services => generated 791 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:35:37.539906 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:35:37.540940 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Dec 16 14:35:37.541355 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 32/65] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:35:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:35:37.777114 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-2e741fb5-7da3-4fda-9c16-4fdea1ae3a0e admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:35:37.784378 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:35:37.784378 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: warnings.warn(msg) Dec 16 14:35:37.785902 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-2e741fb5-7da3-4fda-9c16-4fdea1ae3a0e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:35:37.786370 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-2e741fb5-7da3-4fda-9c16-4fdea1ae3a0e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:35:37.787167 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-2e741fb5-7da3-4fda-9c16-4fdea1ae3a0e admin admin] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:35:37.787592 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-2e741fb5-7da3-4fda-9c16-4fdea1ae3a0e admin admin] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:35:37.811425 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-2e741fb5-7da3-4fda-9c16-4fdea1ae3a0e admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.133748 Dec 16 14:35:37.812354 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Dec 16 14:35:37 2021] GET /compute/v2.1/os-services => generated 791 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:35:49.727450 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:35:49.728907 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 Dec 16 14:35:49.729236 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 33/67] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:35:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:35:50.021357 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-59244f0f-cbd6-4920-90f4-4b12424e13bd admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:35:50.027753 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:35:50.027753 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: warnings.warn(msg) Dec 16 14:35:50.031270 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-59244f0f-cbd6-4920-90f4-4b12424e13bd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:35:50.032608 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-59244f0f-cbd6-4920-90f4-4b12424e13bd admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:35:50.033524 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-59244f0f-cbd6-4920-90f4-4b12424e13bd admin admin] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:35:50.034906 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-59244f0f-cbd6-4920-90f4-4b12424e13bd admin admin] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:35:50.073778 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-59244f0f-cbd6-4920-90f4-4b12424e13bd admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.151648 Dec 16 14:35:50.074378 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Dec 16 14:35:49 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:35:51.734195 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: DEBUG nova.api.openstack.wsgi [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] Calling method '>' {{(pid=82176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:35:51.735197 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: INFO nova.api.openstack.requestlog [None req-031c8f4c-0c33-4c3e-9af7-06bc6266f345 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001772 Dec 16 14:35:51.735583 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: [pid: 82176|app: 0|req: 34/69] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Dec 16 14:35:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:35:51.978353 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG nova.api.openstack.wsgi [None req-7d9e2eba-d709-41ca-88e5-8e94825d06f8 admin admin] Calling method '>' {{(pid=82177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:35:51.984323 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:35:51.984323 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: warnings.warn(msg) Dec 16 14:35:51.985944 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-7d9e2eba-d709-41ca-88e5-8e94825d06f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:35:51.986380 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-7d9e2eba-d709-41ca-88e5-8e94825d06f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:35:51.987182 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-7d9e2eba-d709-41ca-88e5-8e94825d06f8 admin admin] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:35:51.987637 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: DEBUG oslo_concurrency.lockutils [None req-7d9e2eba-d709-41ca-88e5-8e94825d06f8 admin admin] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:35:52.018079 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: INFO nova.api.openstack.requestlog [None req-7d9e2eba-d709-41ca-88e5-8e94825d06f8 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.137979 Dec 16 14:35:52.018798 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: [pid: 82177|app: 0|req: 36/70] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Dec 16 14:35:51 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:36:50.961092 dv-cinder-821893-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 16 14:36:50.961822 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: Thu Dec 16 14:36:50 2021 - graceful shutdown triggered... Dec 16 14:36:50.962308 dv-cinder-821893-3-iscsi devstack@n-api.service[82177]: Gracefully killing worker 2 (pid: 82177)... Dec 16 14:36:50.962694 dv-cinder-821893-3-iscsi devstack@n-api.service[82176]: Gracefully killing worker 1 (pid: 82176)... Dec 16 14:36:51.962128 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: worker 1 buried after 1 seconds Dec 16 14:36:51.962128 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: worker 2 buried after 1 seconds Dec 16 14:36:51.962128 dv-cinder-821893-3-iscsi devstack@n-api.service[82175]: goodbye to uWSGI. Dec 16 14:36:51.963746 dv-cinder-821893-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 16 14:36:51.964317 dv-cinder-821893-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 16 14:36:51.967210 dv-cinder-821893-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 14:36:51.978684 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 14:36:51 2021] *** Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: nodename: dv-cinder-821893-3-iscsi Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: machine: x86_64 Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: clock source: unix Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: pcre jit disabled Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: detected number of CPU cores: 4 Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: current working directory: / Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: detected binary path: /usr/bin/uwsgi-core Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: your processes number limit is 47680 Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: your memory page size is 4096 bytes Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: detected max file descriptor number: 2048 Dec 16 14:36:51.980767 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: lock engine: pthread robust mutexes Dec 16 14:36:51.981729 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: thunder lock: enabled Dec 16 14:36:51.981729 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 14:36:51.981729 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 14:36:52.021609 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: Python main interpreter initialized at 0x5560234919c0 Dec 16 14:36:52.021609 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: python threads support enabled Dec 16 14:36:52.021609 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: your server socket listen backlog is limited to 100 connections Dec 16 14:36:52.021609 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: your mercy for graceful operations on workers is 90 seconds Dec 16 14:36:52.023190 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 14:36:52.023190 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: *** Operational MODE: preforking *** Dec 16 14:36:52.023190 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: *** uWSGI is running in multiple interpreter mode *** Dec 16 14:36:52.023190 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: spawned uWSGI master process (pid: 96653) Dec 16 14:36:52.022702 dv-cinder-821893-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 14:36:52.024477 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: spawned uWSGI worker 1 (pid: 96669, cores: 1) Dec 16 14:36:52.024477 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: spawned uWSGI worker 2 (pid: 96670, cores: 1) Dec 16 14:36:52.024477 dv-cinder-821893-3-iscsi devstack@n-api.service[96653]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 14:36:56.158075 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:36:56.159178 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:36:56.159824 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:36:56.160343 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:36:56.160757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:36:56.161471 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.161775 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.162289 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.162785 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.163300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.163625 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.163966 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.164266 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.164598 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.164918 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.165230 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.165684 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.166030 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.166372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821893-3-iscsi {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.166698 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.167010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.167326 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.167644 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.167950 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.168276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.168578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.169090 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.169803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.170309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.170800 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.171164 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.171493 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.171802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.172112 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.172525 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.173670 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.173961 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.174475 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821893-3-iscsi {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.174803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.175120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.175604 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.176232 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.176552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.176868 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.177197 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.177526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.177833 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.178209 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.178536 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.178884 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.179191 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.179495 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.179806 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.180117 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.180439 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.180748 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.181058 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.181308 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.181613 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.181943 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.182295 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.182626 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.182876 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.183292 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.183786 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.184114 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.184429 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.184743 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.185049 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.185367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.185674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.185982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.186315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.186623 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.186946 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.187266 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.187589 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.187947 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.188798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.189220 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.189480 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.189794 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.190177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.190505 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.190820 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.191143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.191469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.191814 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.192126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.192584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.193018 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.193687 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.193687 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.194029 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.194179 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.194471 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.194802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.195113 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.195422 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.195733 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.196082 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.196341 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.196649 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.196955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.197264 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.197572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.197879 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.198255 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.198537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.198856 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.199184 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.199508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.199815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.200121 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.200426 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.200733 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.201060 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.201369 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.201675 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.202034 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.202332 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.202639 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.202966 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.203273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.203961 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.204498 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.204811 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.205121 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.205451 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.205824 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.206111 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.206423 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.206729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.207045 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.207345 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.207649 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.207959 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.208260 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.208585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.209282 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.209566 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.209880 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.210217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.210536 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.210879 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.211214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.211568 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.211882 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.212220 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.212554 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.212875 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.213273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.213507 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.214147 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.214312 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.214492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.214911 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.215130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.215449 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.215782 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.216107 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.216520 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.216748 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.217069 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.217388 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.217718 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.218076 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.218392 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.218736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.219086 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.219901 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.220337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.220689 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.220991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.221314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.221638 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.221953 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.222294 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.222609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.222950 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.223281 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.223598 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.224312 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.224312 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.224627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.224782 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.225092 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.225413 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.225744 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.226080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.226416 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.226726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.227037 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.227350 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.227656 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.227970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.228282 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.228592 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.228916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.229234 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.229548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.229874 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.230210 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.230517 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.230829 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.231140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.231515 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.231842 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.232156 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.232469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.232806 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.233138 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.233447 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.233780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.234522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.234522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.234909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.235458 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.235942 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.236284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.236608 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.236989 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.237279 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.237598 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.237920 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.238298 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.238609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.238947 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.239416 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.239740 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.240275 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.240650 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.240980 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.241323 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.241763 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.242135 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.242465 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.242795 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.243134 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.243512 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.243791 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.244084 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.244813 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.244813 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.245130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.245578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.245738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.245999 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.246347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.246661 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.247050 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.247287 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.247608 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.247930 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.248249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.248587 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.248901 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.249224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.249542 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.249857 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.250204 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.250577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.250899 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.251226 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.251537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.251851 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.252151 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.252463 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.252798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.253132 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.253442 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.253750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.254188 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.254994 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.255170 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:36:56.255890 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.256053 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:36:56.256215 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.256215 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.256621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:36:56.256781 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.256926 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:36:56.257172 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.257466 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:36:56.257656 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.257805 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.257949 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.258240 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.258418 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.258578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.258732 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.258877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.259021 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.259244 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.259415 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.259571 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.259732 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.259877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.260029 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.260180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.260336 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.260490 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.260642 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.260792 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.260934 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.261092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.261237 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.261386 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.261532 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.261694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.261852 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.262026 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821893-3-iscsi {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.262176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.262320 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.262475 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.262621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.262771 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.262929 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.263073 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.263224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.263369 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.263513 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.263682 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.263855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.264213 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.264373 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.264547 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.264547 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.265429 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.265609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.265764 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.265936 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.266296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.266473 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.266811 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.266991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.266991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.267270 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.267424 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.267707 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.267858 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.268013 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.268167 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.268167 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.268460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.268614 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.268781 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.268927 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.269087 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.269232 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.269232 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.269513 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.269666 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.269812 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821893-3-iscsi {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.269957 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.270139 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.270298 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.270452 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.270627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.270627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.270919 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.271072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.271072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.271364 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.271510 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.271653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.271653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.271924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.272068 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.272222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.272367 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.272522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.272674 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.272825 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.272984 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.273130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.273281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.273426 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.273578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.273723 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.273880 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.274068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.274450 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.274602 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.274758 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.275535 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.275843 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.276016 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.276165 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.276327 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.276597 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.276773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.277029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.277178 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.277331 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.277484 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.277637 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.278056 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.278211 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.278372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.278607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.278762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.278921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.279085 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.279245 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.279245 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.279552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.279552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.279876 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.280045 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.280204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.280365 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.280530 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.280681 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.280853 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.280853 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.281215 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.281215 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.281581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.281581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.282077 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.282264 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.282419 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.282572 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.282815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.283033 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.283204 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.283364 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.283518 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.283683 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.283836 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.284007 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.284216 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.284675 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.284860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.285050 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.285859 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.286051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.286217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.286372 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.286532 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.286875 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.287058 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.287306 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.287469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.287693 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.287872 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.288168 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.288335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.288488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.288639 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.288806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.288973 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.289140 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.289291 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.289442 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.289593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.289752 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.289915 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.290155 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.290309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.290460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.290611 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.290763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.290928 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.291081 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.291241 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.291393 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.291551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.291712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.291874 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.292028 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.292191 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.292342 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.292503 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.292663 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.292824 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.292984 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.293137 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.293287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.293444 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.293606 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.293765 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.293918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.294103 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.294282 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.294443 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.294714 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.294945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.295107 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.295266 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.295522 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.296064 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.296233 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.296394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.296554 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.296714 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.296887 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.297147 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.297398 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.297646 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.297813 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.297971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.298199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.298450 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.298621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.298774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.298933 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.299092 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.299253 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.299416 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.299580 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.299731 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.299935 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.300103 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.300278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.300449 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.300603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.300755 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.300929 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.301081 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.301239 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.301393 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.301551 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.301722 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.301897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.302070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.302226 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.302380 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.302543 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.302703 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.302865 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.302865 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.303163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.303323 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.303484 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.303637 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.303810 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.303963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.304120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.304276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.304428 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.304594 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.304837 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.305092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.305250 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.305417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.306190 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.306308 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.306399 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.306399 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.306723 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.306875 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.307036 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.307308 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.307465 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.307646 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.307886 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.308042 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.308208 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.308361 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.308625 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.308793 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.308957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.309118 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.309285 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:36:56.309444 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.309605 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.309758 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.309918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.310097 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.310262 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.310423 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.310627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.310816 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.310982 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.311151 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.311312 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.311464 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.311624 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.311776 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.311929 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.312089 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.312252 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.312405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.312559 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.312716 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.312898 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.313204 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.313380 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.313544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.313863 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.314081 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.314241 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.314417 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.314571 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.314723 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.314988 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.315260 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.315432 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.315585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.315585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.316480 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.316480 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.316480 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.316955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.317117 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.317277 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.317558 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.317723 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.317902 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.318164 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.318339 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.318505 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.318681 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.318681 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.319084 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.319249 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.319412 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.319565 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.319718 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.319878 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.320043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.320205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.320358 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.320521 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.320685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.320844 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.321004 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.321163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.321324 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.321476 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.321635 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.321793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.321793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.322165 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.322320 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.322482 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.322634 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.322804 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.322971 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.323123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.323275 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.323433 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.323593 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.323593 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.323903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.324062 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.324214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.324377 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.324537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.324702 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.324866 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.325108 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.325281 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.325516 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.325673 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.325860 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.326105 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.326660 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.326833 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.326987 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.327147 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.327312 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.327472 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.327752 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.327910 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.328061 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.328061 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.328454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.328984 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.329295 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.329557 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.329725 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.329888 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.330059 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.330228 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.330401 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.330554 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.330714 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.330879 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.331043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.331274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.331436 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.331597 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.331597 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.331910 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.332062 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.332214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.332365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.332538 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.332691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.332858 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.333019 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.333171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.333322 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.333473 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.333634 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.333794 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.334354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.334514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.334671 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.334823 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.335002 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.335259 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.335418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.335668 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.335824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.335987 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.336238 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.336454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.337001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.337001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.337309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.337470 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.337632 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.337920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.338123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.338307 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.338545 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.338701 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.338863 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.339023 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.339186 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.339444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.339610 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.339777 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.339937 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.340090 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.340258 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.340419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.340572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.340791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.340946 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.341108 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.341269 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.341429 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.341583 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.341751 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.341904 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.342235 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.342414 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.342567 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.342719 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.342884 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.343043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.343202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.343355 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.343506 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.343664 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.343826 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.343978 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.344202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.344397 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.344599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.344815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.345136 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.345136 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.345575 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.345828 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.346003 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.346182 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.346441 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.346605 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.347176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.347338 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.347493 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.347671 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.347825 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.348090 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.348256 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.348416 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.348658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.348830 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.348983 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.349142 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.349302 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.349473 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.349732 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.349890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.350100 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.350265 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.350418 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.350577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.350744 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.350900 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.351064 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.351216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.351376 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.351544 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.351706 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.351860 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.352019 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.352191 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.352351 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.352511 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.352672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.352826 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.352985 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.353137 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.353289 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.353441 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.353602 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.353755 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.353907 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.354080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.354245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.354412 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.354565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.354734 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.354896 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.355056 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.355268 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.355529 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.355696 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.356009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.356204 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.356358 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.356358 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.356783 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.357368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.357536 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.357745 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.357910 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.359106 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.359318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.359568 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.359792 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.360096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.360431 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.360598 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.360772 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.360932 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.361086 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.361247 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.361398 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.361556 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.361708 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.361861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.362091 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.362267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.362421 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.362581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.362741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.362905 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.363058 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.363220 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.363380 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.363539 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.363699 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.363852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.363852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.364152 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.364312 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.364478 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.364631 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.364796 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.364972 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.365125 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.365285 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.365446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.365729 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.365887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.366187 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.366348 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.366509 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.366773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.366930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.366930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.367803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.367960 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.368112 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.368271 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.368432 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.368586 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.369085 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.369339 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.369496 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.369649 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.369800 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.369963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.369963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.370426 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.370581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.370744 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.370899 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.371060 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.371213 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.371372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.371525 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.371679 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.371831 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.372005 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.372175 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.372329 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.372542 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.372737 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.372903 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.373066 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.373220 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.373382 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.373536 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.373698 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.373862 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.374112 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.374298 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.375303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.375614 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.376027 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.376216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.376482 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.376657 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.376942 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.377105 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.377379 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.378105 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.378270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.378424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.378576 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.378742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.378904 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.379078 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.379378 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.379625 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.379790 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.379944 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.380107 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.380278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.380546 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.380712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.380875 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.381032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.381210 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.381363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.381514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.381666 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.381825 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.382034 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.382194 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.382359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.382512 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.382664 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.382823 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.382989 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.383155 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.383308 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.383459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.383611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.383770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.383932 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.383932 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.384231 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.384392 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.384552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.384706 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.384866 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.385028 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.385192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.385344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.385495 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.385656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.385816 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.386069 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.386228 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.386382 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.386621 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.386796 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.386977 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.387212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.387380 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.387576 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.388088 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.388251 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.388414 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.388575 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.388798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.388955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.389107 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.389266 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.389537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.389770 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.389937 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.390124 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.390300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.390462 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.390723 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.390889 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.390889 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.391218 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.391371 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.391524 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.391682 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.391843 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.392005 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.392166 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.392337 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.392489 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.392643 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.392793 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.392954 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.393121 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.393273 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.393425 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.393578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.393578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.393885 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.394066 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.394224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.394394 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.394555 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.394718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.394718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.395239 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.395413 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.395628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.395628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.395955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.396235 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.396395 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.396558 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.396558 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.396984 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.397162 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.397411 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.397616 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.397616 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.398425 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.398593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.398755 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.398917 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.399069 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.399229 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.399396 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.399956 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.400139 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.400294 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.400453 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.400607 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.400884 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.401068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.401467 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.401644 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.401941 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.402216 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.402383 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.402553 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.402706 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.402871 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.403040 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.403203 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.403370 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.403525 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.403678 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.403829 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.404027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.404201 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.404368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.404529 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.404691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.404891 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.405075 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.405240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.405400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.405589 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.405748 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.405914 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.406126 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.406394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.406553 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.406766 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.407072 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.407231 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.407423 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.407674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.407854 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.407854 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.408647 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.408833 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.409003 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.409205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.409369 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.409541 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.409541 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.410134 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.410306 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.410468 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.410673 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.410871 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.411027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.411179 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.411346 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.411508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.411668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.411828 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.411980 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.412138 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.412300 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.412453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.412617 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.412777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.412931 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.413092 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.413253 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.413405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.413558 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.413725 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.413878 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.414063 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.414229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.414386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.414547 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.414725 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.414878 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.415039 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.415199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.415351 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.415502 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.415670 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.415830 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.415991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.416151 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.416311 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.416569 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.416726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.416903 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.417084 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.417336 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.417501 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.417673 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.417904 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.418342 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.418522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.418785 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.418944 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.419106 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.419258 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.419419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.419593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.419746 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.419906 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.420168 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.420411 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.420582 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.420737 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.420890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.420890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.421189 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.421356 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.421510 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.421681 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.421841 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.422014 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.422171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.422404 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.422564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.422725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.422885 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.423054 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.423206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.423367 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.423528 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.423681 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.423852 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.424018 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.424178 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.424344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.424499 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.424499 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.424806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.424967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.425181 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.425347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.425500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.425660 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.425823 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.425983 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.426199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.426362 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.426523 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.426787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.426951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.427104 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.427270 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.427524 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.427696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.427849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.428107 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.428304 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.428627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.428972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.429131 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.429316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.429477 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.429641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.429808 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.430148 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.430408 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.430676 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.430849 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.430849 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.431185 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.431185 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.431497 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.431654 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.431814 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.431976 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.432137 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.432296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.432450 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.432624 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.432779 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.432945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.433118 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.433280 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.433443 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.433595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.433595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.433903 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.434142 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.434300 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.434453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.434607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.434773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.434934 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.435095 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.435260 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.435411 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.435564 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.435804 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.435968 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.436122 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.436274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.436274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.436584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.436771 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.437037 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.437037 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.437345 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.437553 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.437839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.438108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.438272 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.438504 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.438896 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.439038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.439224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.439551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.439686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.439810 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.439942 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.440080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=96669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:36:56.440224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.440224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.440224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.440224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.440224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.440224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.440224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.440224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.441963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443001 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.443672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.444688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.445946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.446518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.446518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.446518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.446518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.446518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.446518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.446518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.446518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.447696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.449955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.450975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.450975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.450975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.450975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.450975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.450975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.450975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.450975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.451837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.451837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.451837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.451837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.451837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.451837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.451837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.451837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.452463 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.452596 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_db.sqlalchemy.engines [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:36:56.452718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.452718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.453041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.453392 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.453759 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.454115 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.454688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.455036 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.455357 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.455682 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.456007 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.456319 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.456626 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.456948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.457257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.457556 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.457872 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.458205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.458511 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.458815 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.459444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.459754 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.460056 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.460364 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.460823 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.461204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.461531 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.462762 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.463075 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.463393 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.463706 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.464023 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.464324 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.464629 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.464957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.465262 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.465582 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.465888 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.466224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.466529 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.466840 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.467143 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.467466 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.467768 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.468153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.468450 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.468858 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.469256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.469682 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.470263 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.470673 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.471004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.471594 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.471949 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.472254 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.472712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.473127 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.473491 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.473804 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.474302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.474658 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.475024 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.475341 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.475655 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.475968 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.476282 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.476597 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.476927 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.477410 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.477761 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.478099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.478453 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.478918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.479280 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.479951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.480092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.480480 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.480898 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.481270 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.481641 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.482027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.482444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.482763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.483072 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.483741 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.484059 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.484381 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.484708 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.485162 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.485495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.485838 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.486197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.486526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.486835 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.487142 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.487447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.487755 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.488090 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.488409 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.488731 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.489041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.489363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.489678 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.490056 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.490338 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.490658 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.490965 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.491300 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.491611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.491920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.492229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.492537 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.492848 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.493163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.493498 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.493823 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.494149 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.494476 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.494792 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.495112 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.495424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.495733 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.496062 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.496375 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.496688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.496997 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.497311 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.497626 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.497950 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.498300 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.498650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.498946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.499276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.499627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.499940 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.500293 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.500665 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:36:56.500908 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=96670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:36:56.536612 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_db.sqlalchemy.engines [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:36:56.701375 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.context [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d4c520e-4808-4be1-897a-302246289de2(cell1) {{(pid=96669) load_cells /opt/stack/nova/nova/context.py:465}} Dec 16 14:36:56.706122 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:36:56.707816 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:36:56.708638 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:36:56.711067 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:36:56.741014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_db.sqlalchemy.engines [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:36:56.755911 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_db.sqlalchemy.engines [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:36:56.781360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_db.sqlalchemy.engines [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:36:56.793774 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.context [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3d4c520e-4808-4be1-897a-302246289de2(cell1) {{(pid=96670) load_cells /opt/stack/nova/nova/context.py:465}} Dec 16 14:36:56.798444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:36:56.800099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:36:56.800907 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:36:56.802957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:36:56.829199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_db.sqlalchemy.engines [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:36:56.830089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_db.sqlalchemy.engines [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:36:56.860552 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_db.sqlalchemy.engines [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:36:57.027359 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO keyring.backend [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Loading KWallet Dec 16 14:36:57.037493 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO keyring.backend [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Loading SecretService Dec 16 14:36:57.041620 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO keyring.backend [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Loading Windows Dec 16 14:36:57.043554 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO keyring.backend [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Loading chainer Dec 16 14:36:57.044395 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO keyring.backend [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Loading macOS Dec 16 14:36:57.105896 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO keyring.backend [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Loading KWallet Dec 16 14:36:57.115716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO keyring.backend [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Loading SecretService Dec 16 14:36:57.119636 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO keyring.backend [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Loading Windows Dec 16 14:36:57.121528 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO keyring.backend [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Loading chainer Dec 16 14:36:57.122375 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO keyring.backend [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Loading macOS Dec 16 14:36:57.307084 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: WARNING keystonemiddleware.auth_token [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:36:57.313787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: WARNING keystonemiddleware.auth_token [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:36:57.384041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: WARNING keystonemiddleware.auth_token [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:36:57.390710 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: WARNING keystonemiddleware.auth_token [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:36:57.527183 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: WARNING keystonemiddleware.auth_token [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:36:57.532530 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: WARNING keystonemiddleware.auth_token [None req-79ae0887-fe0f-4539-91e4-e050f4b90973 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:36:57.538040 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5560234919c0 pid: 96669 (default app) Dec 16 14:36:57.603307 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: WARNING keystonemiddleware.auth_token [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:36:57.608644 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: WARNING keystonemiddleware.auth_token [None req-40fcd852-d659-4a5d-a89d-a32cd62da5b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:36:57.614140 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5560234919c0 pid: 96670 (default app) Dec 16 14:37:41.788334 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cdeeb634-be79-4b20-9c73-455b99263702 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Action: 'create', calling method: .version_select at 0x7f26fe9ef0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1407547639"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:37:43.603057 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cdeeb634-be79-4b20-9c73-455b99263702 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.967235 Dec 16 14:37:43.604374 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1154 bytes} [Thu Dec 16 14:37:39 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3971 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 16 14:37:44.280418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a1bd2d28-1c28-433c-94db-6ae778cb42a8 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26ff2fe310>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:45.922871 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-725890408", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "networks": [{"uuid": "ac6b60fa-9bd2-492c-8a75-465336d88d1a"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:37:45.923619 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a1bd2d28-1c28-433c-94db-6ae778cb42a8 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 346 microversion: 2.1 time: 2.310285 Dec 16 14:37:45.924680 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 1/2] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:37:43 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 346 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:45.951382 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-25fdee2d-c514-42b0-84f0-e7571382b91f tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Action: 'create', calling method: .version_select at 0x7f26fe95c9d0>, body: {"snapshot": {"volume_id": "db30254b-aca7-45da-b0a9-bb5772773c01", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-733082277"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:37:46.262559 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] validate_networks() for [('ac6b60fa-9bd2-492c-8a75-465336d88d1a', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:37:46.928214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-25fdee2d-c514-42b0-84f0-e7571382b91f tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.991965 Dec 16 14:37:46.929882 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 2/3] 10.222.0.67 () {60 vars in 1161 bytes} [Thu Dec 16 14:37:45 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:46.986517 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fc0f0b44-59c7-40c2-9790-5bab173b60ea tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe854160>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:47.974160 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fc0f0b44-59c7-40c2-9790-5bab173b60ea tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 1.037552 Dec 16 14:37:47.975572 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 3/4] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:46 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:48.043262 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a8bfc7c2-474b-4afd-bffa-4b3b12c18a79 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe817ee0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:48.328791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a8bfc7c2-474b-4afd-bffa-4b3b12c18a79 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.343747 Dec 16 14:37:48.330347 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 4/5] 10.222.0.67 () {58 vars in 1139 bytes} [Thu Dec 16 14:37:47 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:48.382476 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-499df0c8-7468-4305-9e24-3493e5c392ae tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe854310>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:48.519336 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-499df0c8-7468-4305-9e24-3493e5c392ae tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 0.177258 Dec 16 14:37:48.519926 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 5/6] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:48 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:37:49.144555 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:37:49.145409 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:37:49.145787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:37:49.146780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:37:49.146780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:37:49.174150 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:49.174628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:49.181915 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:49.182549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:49.269197 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Getting quotas for project bb69c5ffb21a48ba9f80a543e763d5d4. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:37:49.293159 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Getting quotas for user 108e1d33249b49dcb6e3779514bc7a9b and project bb69c5ffb21a48ba9f80a543e763d5d4. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:37:49.335410 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:37:49.355899 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:37:49.546828 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9daf3de1-e981-4269-a1c0-e7d6b849688c tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe854c10>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:49.562824 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7098d916-4503-46a2-85bf-1fac4b24a600 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.807491 Dec 16 14:37:49.566427 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 2/7] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:37:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 3812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:37:49.606299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1bb41af8-b902-4ed8-a4d7-b5e598f57472 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:49.606938 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1bb41af8-b902-4ed8-a4d7-b5e598f57472 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:37:49.725205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9daf3de1-e981-4269-a1c0-e7d6b849688c tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 0.195827 Dec 16 14:37:49.726097 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 6/8] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:49 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:49.771061 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1bb41af8-b902-4ed8-a4d7-b5e598f57472 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:37:49.808944 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1bb41af8-b902-4ed8-a4d7-b5e598f57472 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1214 microversion: 2.1 time: 0.236042 Dec 16 14:37:49.810572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 3/9] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:37:49 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:37:50.748066 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-562dd999-c617-4fbd-9418-d2f1dc964035 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe854e50>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:50.836194 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b830b1b8-1ee7-4654-a469-7de2fc59a128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:50.836836 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b830b1b8-1ee7-4654-a469-7de2fc59a128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:37:50.942856 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-562dd999-c617-4fbd-9418-d2f1dc964035 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 0.209639 Dec 16 14:37:50.944373 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 7/10] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:50 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:51.045701 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b830b1b8-1ee7-4654-a469-7de2fc59a128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:37:51.063767 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b830b1b8-1ee7-4654-a469-7de2fc59a128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1214 microversion: 2.1 time: 0.239348 Dec 16 14:37:51.065494 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 4/11] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:37:50 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:37:51.976623 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f73e67d8-7e07-40a1-a804-7248428336ce tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe854040>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:52.042154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f73e67d8-7e07-40a1-a804-7248428336ce tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 0.088346 Dec 16 14:37:52.043287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 8/12] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:51 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:52.096167 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ff5323fd-5d39-45e2-a861-f5ae9e719b45 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:52.096783 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ff5323fd-5d39-45e2-a861-f5ae9e719b45 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:37:52.120199 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ff5323fd-5d39-45e2-a861-f5ae9e719b45 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:52.120648 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ff5323fd-5d39-45e2-a861-f5ae9e719b45 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:52.121467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ff5323fd-5d39-45e2-a861-f5ae9e719b45 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:52.121897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ff5323fd-5d39-45e2-a861-f5ae9e719b45 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:52.718592 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ff5323fd-5d39-45e2-a861-f5ae9e719b45 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:37:52.747227 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ff5323fd-5d39-45e2-a861-f5ae9e719b45 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1218 microversion: 2.1 time: 0.665370 Dec 16 14:37:52.760598 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 5/13] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:37:52 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1218 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:37:53.062551 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ec48d67e-671d-421c-bc01-b03a130d1602 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe95c9d0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:53.143416 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ec48d67e-671d-421c-bc01-b03a130d1602 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 287 microversion: 2.1 time: 0.092471 Dec 16 14:37:53.144602 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 9/14] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:53 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:53.166584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-45eae7de-8eba-41d4-91cb-97504298c13f tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe6cba60>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:53.413809 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-45eae7de-8eba-41d4-91cb-97504298c13f tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 202 len: 0 microversion: 2.1 time: 0.262304 Dec 16 14:37:53.418704 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 6/15] 10.222.0.67 () {58 vars in 1253 bytes} [Thu Dec 16 14:37:53 2021] DELETE /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:37:53.447442 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-79f08cf2-4030-4ee5-b6a7-d975639da7ab tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe6d39d0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:53.514972 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ef52e4e0-5fdc-4447-869c-6f19cf2eeb5b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'create', calling method: .version_select at 0x7f26ff050e50>, body: {"keypair": {"name": "tempest-keypair-1036979630"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:37:53.554097 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-79f08cf2-4030-4ee5-b6a7-d975639da7ab tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 0.134032 Dec 16 14:37:53.554685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 7/16] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:53 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:53.599971 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-ef52e4e0-5fdc-4447-869c-6f19cf2eeb5b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for project f78091827c644b1fb185ec17f9aa73e2. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:37:53.610168 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-ef52e4e0-5fdc-4447-869c-6f19cf2eeb5b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for user 6c6c792676f1498e98f638a268abf1e5 and project f78091827c644b1fb185ec17f9aa73e2. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:37:53.775396 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cdd56457-7564-43fa-b38b-2b421ee00f08 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:53.776025 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cdd56457-7564-43fa-b38b-2b421ee00f08 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:37:53.797275 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdd56457-7564-43fa-b38b-2b421ee00f08 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:53.797727 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdd56457-7564-43fa-b38b-2b421ee00f08 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:53.798691 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdd56457-7564-43fa-b38b-2b421ee00f08 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:53.799163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdd56457-7564-43fa-b38b-2b421ee00f08 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:54.113975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cdd56457-7564-43fa-b38b-2b421ee00f08 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:37:54.130264 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cdd56457-7564-43fa-b38b-2b421ee00f08 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1266 microversion: 2.1 time: 0.369184 Dec 16 14:37:54.131218 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 8/17] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:37:53 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:37:54.464091 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-ef52e4e0-5fdc-4447-869c-6f19cf2eeb5b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for project f78091827c644b1fb185ec17f9aa73e2. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:37:54.469435 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-ef52e4e0-5fdc-4447-869c-6f19cf2eeb5b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for user 6c6c792676f1498e98f638a268abf1e5 and project f78091827c644b1fb185ec17f9aa73e2. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:37:54.487084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ef52e4e0-5fdc-4447-869c-6f19cf2eeb5b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.298046 Dec 16 14:37:54.488292 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 10/18] 10.222.0.67 () {60 vars in 1157 bytes} [Thu Dec 16 14:37:53 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:37:54.596171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d12f136d-526e-40da-bdf7-8bf363538138 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe7a2ca0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:54.641201 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c2461b22-bd88-42e4-97ea-bc0ca420293e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'create', calling method: .version_select at 0x7f26fe65f4c0>, body: {"keypair": {"name": "tempest-keypair-1229192028"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:37:54.685292 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-c2461b22-bd88-42e4-97ea-bc0ca420293e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for project 198be39f56934fc58b1c76e532336733. Resources: {'key_pairs'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:37:54.692437 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-c2461b22-bd88-42e4-97ea-bc0ca420293e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for user 0d72966786b641f48edda655d2d0ba45 and project 198be39f56934fc58b1c76e532336733. Resources: {'key_pairs'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:37:54.770240 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d12f136d-526e-40da-bdf7-8bf363538138 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 0.206084 Dec 16 14:37:54.771331 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 11/19] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:54 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:55.128843 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-c2461b22-bd88-42e4-97ea-bc0ca420293e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for project 198be39f56934fc58b1c76e532336733. Resources: {'key_pairs'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:37:55.134386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-c2461b22-bd88-42e4-97ea-bc0ca420293e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for user 0d72966786b641f48edda655d2d0ba45 and project 198be39f56934fc58b1c76e532336733. Resources: {'key_pairs'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:37:55.151556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c2461b22-bd88-42e4-97ea-bc0ca420293e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.793435 Dec 16 14:37:55.159815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 9/20] 10.222.0.67 () {62 vars in 1198 bytes} [Thu Dec 16 14:37:54 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 802 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:37:55.174675 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3ebdedeb-0a22-411a-ba79-a04f683d9700 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:55.180172 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3ebdedeb-0a22-411a-ba79-a04f683d9700 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:37:55.225167 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3ebdedeb-0a22-411a-ba79-a04f683d9700 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:55.226722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3ebdedeb-0a22-411a-ba79-a04f683d9700 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:55.228528 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3ebdedeb-0a22-411a-ba79-a04f683d9700 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:55.231322 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3ebdedeb-0a22-411a-ba79-a04f683d9700 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:55.796151 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-eda47eb2-c612-4974-9789-e1b4aab443f1 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe6cb670>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:55.892189 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-eda47eb2-c612-4974-9789-e1b4aab443f1 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 0.110315 Dec 16 14:37:55.893024 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 10/21] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:55 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:37:55.953655 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3ebdedeb-0a22-411a-ba79-a04f683d9700 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:37:55.968810 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3ebdedeb-0a22-411a-ba79-a04f683d9700 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1266 microversion: 2.1 time: 0.823412 Dec 16 14:37:55.969975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 12/22] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:37:55 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1266 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:37:56.924044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0b91cd01-5536-42b3-8d79-afe6b6871aa2 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe64e1f0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:57.032791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-91f2e992-fe8e-478d-8d44-9fe2e481d04a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:57.046535 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-91f2e992-fe8e-478d-8d44-9fe2e481d04a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:37:57.074787 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-91f2e992-fe8e-478d-8d44-9fe2e481d04a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:57.076179 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-91f2e992-fe8e-478d-8d44-9fe2e481d04a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:57.078041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-91f2e992-fe8e-478d-8d44-9fe2e481d04a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:57.079156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-91f2e992-fe8e-478d-8d44-9fe2e481d04a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:57.095666 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0b91cd01-5536-42b3-8d79-afe6b6871aa2 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 0.193815 Dec 16 14:37:57.097649 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 11/23] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:56 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:57.744744 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-91f2e992-fe8e-478d-8d44-9fe2e481d04a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:37:57.775293 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-91f2e992-fe8e-478d-8d44-9fe2e481d04a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1284 microversion: 2.1 time: 0.791842 Dec 16 14:37:57.776546 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 13/24] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:37:56 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1284 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:37:58.117955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4ee8ff64-035b-4e96-81e6-fca2bd4c7e78 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe64e8b0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:58.285754 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4ee8ff64-035b-4e96-81e6-fca2bd4c7e78 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 200 len: 286 microversion: 2.1 time: 0.179467 Dec 16 14:37:58.286834 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 12/25] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:58 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:58.801133 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-63272147-60ad-4bdb-bab9-a0620240b5a6 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:58.807226 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-63272147-60ad-4bdb-bab9-a0620240b5a6 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:37:58.839762 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-63272147-60ad-4bdb-bab9-a0620240b5a6 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:58.845097 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-63272147-60ad-4bdb-bab9-a0620240b5a6 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:58.847759 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-63272147-60ad-4bdb-bab9-a0620240b5a6 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:58.848423 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-63272147-60ad-4bdb-bab9-a0620240b5a6 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:59.272047 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-63272147-60ad-4bdb-bab9-a0620240b5a6 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:37:59.290372 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-63272147-60ad-4bdb-bab9-a0620240b5a6 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1272 microversion: 2.1 time: 0.500663 Dec 16 14:37:59.318221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 14/26] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:37:58 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1272 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:37:59.360505 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3baa9656-a064-4c6a-820b-19db8c09584b tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe667c10>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:00.073850 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-211913481", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6169d189-9be4-4abd-beaa-98b69d0a6fcc"}], "security_groups": [{"name": "tempest-securitygroup--1152521513"}], "key_name": "tempest-keypair-1036979630", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:00.409605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-3baa9656-a064-4c6a-820b-19db8c09584b tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] HTTP exception thrown: Snapshot eac9d55f-532e-4a26-9da4-10b6a2b2bf88 could not be found. Dec 16 14:38:00.413714 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3baa9656-a064-4c6a-820b-19db8c09584b tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Returning 404 to user: Snapshot eac9d55f-532e-4a26-9da4-10b6a2b2bf88 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:38:00.416145 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3baa9656-a064-4c6a-820b-19db8c09584b tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88" status: 404 len: 111 microversion: 2.1 time: 1.109198 Dec 16 14:38:00.419859 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 13/27] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:37:59 2021] GET /compute/v2.1/os-snapshots/eac9d55f-532e-4a26-9da4-10b6a2b2bf88 => generated 111 bytes in 1114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:38:00.507264 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d79cab93-21e6-41ac-b6a7-289eaec580cc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:00.508335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d79cab93-21e6-41ac-b6a7-289eaec580cc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:00.529672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d79cab93-21e6-41ac-b6a7-289eaec580cc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:00.530954 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d79cab93-21e6-41ac-b6a7-289eaec580cc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:00.533751 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d79cab93-21e6-41ac-b6a7-289eaec580cc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:00.534773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d79cab93-21e6-41ac-b6a7-289eaec580cc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:00.697883 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.network.neutron [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] validate_networks() for [('6169d189-9be4-4abd-beaa-98b69d0a6fcc', None, None, None)] {{(pid=96670) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:38:03.007384 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Flavor limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:38:03.008591 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Image limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:38:03.009212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Flavor pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:38:03.009740 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Image pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:38:03.010324 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:38:03.019621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:03.020246 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:03.021221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:03.021834 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:03.043682 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for project f78091827c644b1fb185ec17f9aa73e2. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:38:03.053715 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d79cab93-21e6-41ac-b6a7-289eaec580cc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:03.059068 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for user 6c6c792676f1498e98f638a268abf1e5 and project f78091827c644b1fb185ec17f9aa73e2. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:38:03.105801 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d79cab93-21e6-41ac-b6a7-289eaec580cc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 2.669480 Dec 16 14:38:03.107296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 14/28] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:00 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 2682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:03.111926 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Going to run 1 instances... {{(pid=96670) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:38:03.122055 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:38:03.152325 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fb28f3d4-b1c8-47f2-820f-4e843b09d004 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe64ed30>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:03.403920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0e7e28f1-3bfe-4529-b5fd-c3f3eace74b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.342132 Dec 16 14:38:03.414409 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 15/29] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:38:00 2021] POST /compute/v2.1/servers => generated 402 bytes in 3346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:38:03.472654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-640485058", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fdb01c2-4dfe-48d4-ba53-23a0b176f0fb"}], "security_groups": [{"name": "tempest-securitygroup--1221118471"}], "key_name": "tempest-keypair-1229192028", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:03.573068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fb28f3d4-b1c8-47f2-820f-4e843b09d004 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 202 len: 0 microversion: 2.1 time: 0.462459 Dec 16 14:38:03.574380 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 15/30] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Dec 16 14:38:03 2021] DELETE /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:38:03.653957 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7860219c-3d55-4c35-9e6e-09f7e2e39848 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:03.660124 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7860219c-3d55-4c35-9e6e-09f7e2e39848 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:04.177049 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7860219c-3d55-4c35-9e6e-09f7e2e39848 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:04.231982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7860219c-3d55-4c35-9e6e-09f7e2e39848 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1237 microversion: 2.1 time: 0.649074 Dec 16 14:38:04.234034 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 16/31] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:03 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1237 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:04.282972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9dbbf2b0-66a8-41b9-9214-1959e3330561 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe64eaf0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:04.326385 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.network.neutron [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] validate_networks() for [('2fdb01c2-4dfe-48d4-ba53-23a0b176f0fb', None, None, None)] {{(pid=96670) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:38:04.650911 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9dbbf2b0-66a8-41b9-9214-1959e3330561 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 345 microversion: 2.1 time: 0.414095 Dec 16 14:38:04.653511 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 17/32] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:04 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 345 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:04.679698 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0c4e2480-a42d-4946-bf8e-a9b80043f11d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:04.680916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0c4e2480-a42d-4946-bf8e-a9b80043f11d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:04.715458 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c4e2480-a42d-4946-bf8e-a9b80043f11d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:04.717076 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c4e2480-a42d-4946-bf8e-a9b80043f11d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:04.718584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c4e2480-a42d-4946-bf8e-a9b80043f11d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:04.719597 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c4e2480-a42d-4946-bf8e-a9b80043f11d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:05.113261 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-0c4e2480-a42d-4946-bf8e-a9b80043f11d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:05.126365 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0c4e2480-a42d-4946-bf8e-a9b80043f11d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.470333 Dec 16 14:38:05.127192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 18/33] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:04 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:05.308832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-ae8b32d1-4913-4660-9a53-bb801c05f032 req-de5d74a6-1789-4aa2-9119-fe6aa18f8fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4cf5bc-8f2b-4e78-93cd-a3097aa16030", "tag": "4288c836-920e-4dde-9566-78d211f0412e"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:05.316273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:38:05.316273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:38:05.326038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-ae8b32d1-4913-4660-9a53-bb801c05f032 req-de5d74a6-1789-4aa2-9119-fe6aa18f8fd7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:05.326798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-ae8b32d1-4913-4660-9a53-bb801c05f032 req-de5d74a6-1789-4aa2-9119-fe6aa18f8fd7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:05.353803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-ae8b32d1-4913-4660-9a53-bb801c05f032 req-de5d74a6-1789-4aa2-9119-fe6aa18f8fd7 service nova] Creating event network-changed:4288c836-920e-4dde-9566-78d211f0412e for instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 on hv-cinder-82189 Dec 16 14:38:05.354442 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-ae8b32d1-4913-4660-9a53-bb801c05f032 req-de5d74a6-1789-4aa2-9119-fe6aa18f8fd7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=96669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 14:38:05.355726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7807df0e-58e1-4a99-b888-46d704a7e1df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:05.356413 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7807df0e-58e1-4a99-b888-46d704a7e1df None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:05.357219 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7807df0e-58e1-4a99-b888-46d704a7e1df None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:05.357767 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7807df0e-58e1-4a99-b888-46d704a7e1df None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:05.367387 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.compute.rpcapi [None req-7807df0e-58e1-4a99-b888-46d704a7e1df None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 16 14:38:05.368304 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7807df0e-58e1-4a99-b888-46d704a7e1df None None] Releasing lock "compute-rpcapi-router" {{(pid=96669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 14:38:05.401047 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7807df0e-58e1-4a99-b888-46d704a7e1df None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272366 Dec 16 14:38:05.402396 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 19/34] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:38:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:05.427587 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8fd4f9c8-d2a9-4e18-b1dd-9c8c27002cd0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:05.429850 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8fd4f9c8-d2a9-4e18-b1dd-9c8c27002cd0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:05.438910 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8fd4f9c8-d2a9-4e18-b1dd-9c8c27002cd0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:05.439408 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8fd4f9c8-d2a9-4e18-b1dd-9c8c27002cd0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:05.440405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8fd4f9c8-d2a9-4e18-b1dd-9c8c27002cd0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:05.440848 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8fd4f9c8-d2a9-4e18-b1dd-9c8c27002cd0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:05.558672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Flavor limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:38:05.559640 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Image limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:38:05.560237 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Flavor pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:38:05.560714 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Image pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:38:05.561185 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:38:05.577578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:05.578058 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:05.578333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8fd4f9c8-d2a9-4e18-b1dd-9c8c27002cd0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:05.578843 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:05.579266 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:05.586945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8fd4f9c8-d2a9-4e18-b1dd-9c8c27002cd0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.183267 Dec 16 14:38:05.587517 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 20/35] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:05 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:05.598340 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for project 198be39f56934fc58b1c76e532336733. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:38:05.602619 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for user 0d72966786b641f48edda655d2d0ba45 and project 198be39f56934fc58b1c76e532336733. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:38:05.614265 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Going to run 1 instances... {{(pid=96670) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:38:05.616875 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:38:05.667267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a2c1a160-29c6-4dcc-93ab-163dc12b4f54 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.258107 Dec 16 14:38:05.673410 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 16/36] 10.222.0.67 () {62 vars in 1187 bytes} [Thu Dec 16 14:38:03 2021] POST /compute/v2.1/servers => generated 402 bytes in 2265 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 16 14:38:05.675543 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-75002906-b7b5-424e-a047-a86952ac3d76 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe614940>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:05.685690 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f0865b00-9e86-4c75-8043-7f01d4ee453c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:05.686498 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f0865b00-9e86-4c75-8043-7f01d4ee453c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:05.799165 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-75002906-b7b5-424e-a047-a86952ac3d76 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 345 microversion: 2.1 time: 0.134534 Dec 16 14:38:05.799740 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 21/37] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:05 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:38:05.801314 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f0865b00-9e86-4c75-8043-7f01d4ee453c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:05.822884 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f0865b00-9e86-4c75-8043-7f01d4ee453c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:05.829725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f0865b00-9e86-4c75-8043-7f01d4ee453c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:05.831047 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f0865b00-9e86-4c75-8043-7f01d4ee453c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1281 microversion: 2.20 time: 0.156360 Dec 16 14:38:05.831668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 17/38] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:05 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:06.167161 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f1a65ba8-a650-4123-a21e-91c11132001f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:06.174094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f1a65ba8-a650-4123-a21e-91c11132001f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:06.198854 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f1a65ba8-a650-4123-a21e-91c11132001f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:06.200454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f1a65ba8-a650-4123-a21e-91c11132001f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:06.202054 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f1a65ba8-a650-4123-a21e-91c11132001f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:06.203960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f1a65ba8-a650-4123-a21e-91c11132001f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:06.531832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f1a65ba8-a650-4123-a21e-91c11132001f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:06.546158 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f1a65ba8-a650-4123-a21e-91c11132001f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.394168 Dec 16 14:38:06.546950 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 22/39] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:06 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:06.614148 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d6dae60c-c04f-4b08-82ca-f1d63eb35371 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:06.615476 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d6dae60c-c04f-4b08-82ca-f1d63eb35371 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:06.624305 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d6dae60c-c04f-4b08-82ca-f1d63eb35371 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:06.624754 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d6dae60c-c04f-4b08-82ca-f1d63eb35371 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:06.625544 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d6dae60c-c04f-4b08-82ca-f1d63eb35371 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:06.625983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d6dae60c-c04f-4b08-82ca-f1d63eb35371 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:06.770825 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d6dae60c-c04f-4b08-82ca-f1d63eb35371 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:06.780418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d6dae60c-c04f-4b08-82ca-f1d63eb35371 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.179599 Dec 16 14:38:06.780908 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 18/40] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:06 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:06.817385 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0d0bece6-c9d1-4bb3-a8ba-9853b2b4b19d tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe64eb80>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:06.864333 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:06.865381 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:06.877583 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:06.878763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:06.880499 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:06.881576 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:06.919302 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0d0bece6-c9d1-4bb3-a8ba-9853b2b4b19d tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 345 microversion: 2.1 time: 0.110955 Dec 16 14:38:06.919868 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 23/41] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:06 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:07.050370 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:07.067408 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:07.074485 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:07.075611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5b2fdbeb-888e-4de4-8fcc-ecb6454118dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.229573 Dec 16 14:38:07.087442 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 19/42] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:06 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:07.573270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c485a1f9-e548-4617-b188-e3b5393cb2a9 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:07.573959 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c485a1f9-e548-4617-b188-e3b5393cb2a9 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:07.582818 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c485a1f9-e548-4617-b188-e3b5393cb2a9 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:07.583276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c485a1f9-e548-4617-b188-e3b5393cb2a9 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:07.584150 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c485a1f9-e548-4617-b188-e3b5393cb2a9 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:07.584731 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c485a1f9-e548-4617-b188-e3b5393cb2a9 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:07.812881 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-75791903-a16c-4c07-858c-1ea446b69023 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:07.813514 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-75791903-a16c-4c07-858c-1ea446b69023 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:07.837199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75791903-a16c-4c07-858c-1ea446b69023 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:07.837654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75791903-a16c-4c07-858c-1ea446b69023 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:07.845058 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75791903-a16c-4c07-858c-1ea446b69023 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:07.845594 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75791903-a16c-4c07-858c-1ea446b69023 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:07.884379 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c485a1f9-e548-4617-b188-e3b5393cb2a9 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:07.896012 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c485a1f9-e548-4617-b188-e3b5393cb2a9 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.331037 Dec 16 14:38:07.906052 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 24/43] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:07 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:07.948258 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a71eb1bb-37ce-4c52-a4a4-5cb8897cac7d tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe614e50>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:08.015633 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-75791903-a16c-4c07-858c-1ea446b69023 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:08.033284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-75791903-a16c-4c07-858c-1ea446b69023 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.240254 Dec 16 14:38:08.033776 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 20/44] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:07 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:08.127456 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:08.130231 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:08.133244 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a71eb1bb-37ce-4c52-a4a4-5cb8897cac7d tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 345 microversion: 2.1 time: 0.201633 Dec 16 14:38:08.133816 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 25/45] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:07 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 345 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:38:08.149447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:08.150315 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:08.151504 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:08.152201 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:08.350393 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:08.368838 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:08.375713 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:08.377032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-15ad5a5f-a340-42d9-be72-9e96762bd82c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.285339 Dec 16 14:38:08.388596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 21/46] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:08 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:38:08.919213 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-281d2114-63fe-4dac-afc4-8248246c9595 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:08.919836 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-281d2114-63fe-4dac-afc4-8248246c9595 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:08.934981 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-281d2114-63fe-4dac-afc4-8248246c9595 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:08.935442 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-281d2114-63fe-4dac-afc4-8248246c9595 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:08.936247 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-281d2114-63fe-4dac-afc4-8248246c9595 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:08.936681 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-281d2114-63fe-4dac-afc4-8248246c9595 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:09.059924 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f660d628-2048-4cb1-8ef7-b023bbdb7bf8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:09.060556 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f660d628-2048-4cb1-8ef7-b023bbdb7bf8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:09.070132 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f660d628-2048-4cb1-8ef7-b023bbdb7bf8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:09.070824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f660d628-2048-4cb1-8ef7-b023bbdb7bf8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:09.071970 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f660d628-2048-4cb1-8ef7-b023bbdb7bf8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:09.072532 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f660d628-2048-4cb1-8ef7-b023bbdb7bf8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:09.231075 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f660d628-2048-4cb1-8ef7-b023bbdb7bf8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:09.242305 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f660d628-2048-4cb1-8ef7-b023bbdb7bf8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.193046 Dec 16 14:38:09.243154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 22/47] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:09 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:09.255588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-eb4cc0b0-ff68-44f6-a75f-cddf8a7f38c0 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe6cd700>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:09.268469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-281d2114-63fe-4dac-afc4-8248246c9595 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:09.278260 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-281d2114-63fe-4dac-afc4-8248246c9595 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.368588 Dec 16 14:38:09.286044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 26/48] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:08 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:09.359095 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-eb4cc0b0-ff68-44f6-a75f-cddf8a7f38c0 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 345 microversion: 2.1 time: 0.114648 Dec 16 14:38:09.359702 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 23/49] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:09 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:09.401774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:09.402585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:09.411586 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:09.411747 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:09.412617 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:09.413161 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:09.559105 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:09.573779 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:09.580072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:09.581145 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6848b73e-6001-445c-9d72-dd5f8d2527b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.190112 Dec 16 14:38:09.581696 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 27/50] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:09 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:10.277089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cab643b1-e225-4107-9957-4d93e5a9601c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:10.279567 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cab643b1-e225-4107-9957-4d93e5a9601c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:10.311691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cab643b1-e225-4107-9957-4d93e5a9601c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:10.312544 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cab643b1-e225-4107-9957-4d93e5a9601c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:10.314230 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cab643b1-e225-4107-9957-4d93e5a9601c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:10.315018 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cab643b1-e225-4107-9957-4d93e5a9601c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:10.316459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c4e63479-7d27-4645-86e0-87cd59248452 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:10.318416 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c4e63479-7d27-4645-86e0-87cd59248452 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:10.338417 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c4e63479-7d27-4645-86e0-87cd59248452 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:10.339677 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c4e63479-7d27-4645-86e0-87cd59248452 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:10.341611 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c4e63479-7d27-4645-86e0-87cd59248452 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:10.342905 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c4e63479-7d27-4645-86e0-87cd59248452 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:10.497310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cab643b1-e225-4107-9957-4d93e5a9601c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:10.515061 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cab643b1-e225-4107-9957-4d93e5a9601c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.256117 Dec 16 14:38:10.516116 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 24/51] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:10 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:10.535316 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-815de162-4d19-4b27-a1d1-ab0c86196a33 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe6af8b0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:10.606391 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c4e63479-7d27-4645-86e0-87cd59248452 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:10.617453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c4e63479-7d27-4645-86e0-87cd59248452 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.323806 Dec 16 14:38:10.627040 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 28/52] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:10 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:10.640106 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:10.640724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:10.651260 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:10.652020 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:10.653067 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:10.653504 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:10.687283 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-815de162-4d19-4b27-a1d1-ab0c86196a33 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 345 microversion: 2.1 time: 0.165200 Dec 16 14:38:10.688407 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 25/53] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:10 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 345 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:10.857694 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:10.872810 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:10.879331 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:10.880908 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c307a33e-5054-4414-9a86-de8e36881d0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.251647 Dec 16 14:38:10.890175 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 29/54] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:10 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:11.538512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-432d069b-45f0-4f5e-a6ec-c509426716a7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:11.539233 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-432d069b-45f0-4f5e-a6ec-c509426716a7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:11.548224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-432d069b-45f0-4f5e-a6ec-c509426716a7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:11.548782 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-432d069b-45f0-4f5e-a6ec-c509426716a7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:11.549669 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-432d069b-45f0-4f5e-a6ec-c509426716a7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:11.554129 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-432d069b-45f0-4f5e-a6ec-c509426716a7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:11.642124 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ee8bb7e4-1bfd-4efb-83b9-b0320a42ed9d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:11.642674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ee8bb7e4-1bfd-4efb-83b9-b0320a42ed9d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:11.650381 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee8bb7e4-1bfd-4efb-83b9-b0320a42ed9d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:11.651259 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee8bb7e4-1bfd-4efb-83b9-b0320a42ed9d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:11.652053 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee8bb7e4-1bfd-4efb-83b9-b0320a42ed9d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:11.652483 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee8bb7e4-1bfd-4efb-83b9-b0320a42ed9d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:11.739256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-432d069b-45f0-4f5e-a6ec-c509426716a7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:11.754672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-432d069b-45f0-4f5e-a6ec-c509426716a7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.225630 Dec 16 14:38:11.755912 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 26/55] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:11 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:11.766994 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c3d324f3-939e-4abf-9388-ee4fe5db432b tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe6afca0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:11.962028 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c3d324f3-939e-4abf-9388-ee4fe5db432b tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 345 microversion: 2.1 time: 0.204595 Dec 16 14:38:11.969625 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 27/56] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:11 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:11.975176 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:11.976142 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:12.002489 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:12.002489 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:12.002810 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ee8bb7e4-1bfd-4efb-83b9-b0320a42ed9d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:12.003344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:12.003848 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:12.023425 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ee8bb7e4-1bfd-4efb-83b9-b0320a42ed9d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.390943 Dec 16 14:38:12.023991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 30/57] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:11 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:12.213190 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:12.228150 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:12.234507 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:12.235593 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3a603839-5a64-49b3-8984-050f6bde0c7d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.271891 Dec 16 14:38:12.236309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 28/58] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:11 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:12.778740 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-552d6c5a-4727-4fda-9c02-0efef8651607 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:12.779615 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-552d6c5a-4727-4fda-9c02-0efef8651607 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:12.788095 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-552d6c5a-4727-4fda-9c02-0efef8651607 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:12.788544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-552d6c5a-4727-4fda-9c02-0efef8651607 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:12.789325 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-552d6c5a-4727-4fda-9c02-0efef8651607 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:12.789753 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-552d6c5a-4727-4fda-9c02-0efef8651607 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:12.943659 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-552d6c5a-4727-4fda-9c02-0efef8651607 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:12.953115 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-552d6c5a-4727-4fda-9c02-0efef8651607 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.184162 Dec 16 14:38:12.953758 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 31/59] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:12 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:12.983272 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-066f77a9-0e27-468d-a96b-e492fddcfa1e tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe6af310>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:13.047882 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-dda2f6c3-97e8-4690-939f-79505c186e85 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:13.048757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-dda2f6c3-97e8-4690-939f-79505c186e85 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:13.057723 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dda2f6c3-97e8-4690-939f-79505c186e85 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:13.058269 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dda2f6c3-97e8-4690-939f-79505c186e85 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:13.059149 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dda2f6c3-97e8-4690-939f-79505c186e85 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:13.059642 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dda2f6c3-97e8-4690-939f-79505c186e85 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:13.093084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-066f77a9-0e27-468d-a96b-e492fddcfa1e tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 345 microversion: 2.1 time: 0.119759 Dec 16 14:38:13.094326 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 29/60] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:12 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:13.261319 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:13.262208 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:13.272601 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:13.273324 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:13.274998 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:13.275665 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:13.454309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-dda2f6c3-97e8-4690-939f-79505c186e85 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:13.464239 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-dda2f6c3-97e8-4690-939f-79505c186e85 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.427067 Dec 16 14:38:13.467343 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:13.475009 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 32/61] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:13 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:13.487829 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:13.496256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:13.497353 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c42e0633-d25f-4342-89bf-a22302b695e5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.248259 Dec 16 14:38:13.497967 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 30/62] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:13 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:38:13.977161 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2ce64c26-822d-44a4-9281-79113738c0f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:13.977948 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2ce64c26-822d-44a4-9281-79113738c0f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:13.986923 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2ce64c26-822d-44a4-9281-79113738c0f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:13.987367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2ce64c26-822d-44a4-9281-79113738c0f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:13.988136 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2ce64c26-822d-44a4-9281-79113738c0f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:13.988563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2ce64c26-822d-44a4-9281-79113738c0f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:14.112165 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c0ca12cb-fa42-40f7-b86d-e7a880d80add tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe5bcaf0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:14.172176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2ce64c26-822d-44a4-9281-79113738c0f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:14.182381 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2ce64c26-822d-44a4-9281-79113738c0f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.215229 Dec 16 14:38:14.183356 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 33/63] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:13 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:14.289319 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c0ca12cb-fa42-40f7-b86d-e7a880d80add tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 200 len: 345 microversion: 2.1 time: 0.186281 Dec 16 14:38:14.289903 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 31/64] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:14 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 345 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:14.502508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b5d629aa-e186-4042-8a3c-06e5c2e06f00 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:14.522722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:14.523485 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:14.527100 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b5d629aa-e186-4042-8a3c-06e5c2e06f00 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:14.542660 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b5d629aa-e186-4042-8a3c-06e5c2e06f00 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:14.544061 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b5d629aa-e186-4042-8a3c-06e5c2e06f00 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:14.546894 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:14.547396 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b5d629aa-e186-4042-8a3c-06e5c2e06f00 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:14.550193 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b5d629aa-e186-4042-8a3c-06e5c2e06f00 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:14.550759 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:14.560940 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:14.562194 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:15.016381 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:15.064482 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:15.079147 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:15.081566 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-47d63825-3aac-42ef-82bb-8c1e1359be0d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.569906 Dec 16 14:38:15.095280 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b5d629aa-e186-4042-8a3c-06e5c2e06f00 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:15.098958 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:14 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:15.107860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b5d629aa-e186-4042-8a3c-06e5c2e06f00 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.627487 Dec 16 14:38:15.119606 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 34/66] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:14 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:15.211656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-05e456f6-703c-4a93-bb9b-83098b2bab86 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:15.212868 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-05e456f6-703c-4a93-bb9b-83098b2bab86 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:15.225185 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-05e456f6-703c-4a93-bb9b-83098b2bab86 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:15.233494 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-05e456f6-703c-4a93-bb9b-83098b2bab86 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:15.235509 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-05e456f6-703c-4a93-bb9b-83098b2bab86 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:15.237235 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-05e456f6-703c-4a93-bb9b-83098b2bab86 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:15.316577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cca4451b-a4c3-457a-8199-015bd3b6066d tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe614550>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:15.477780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-cca4451b-a4c3-457a-8199-015bd3b6066d tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] HTTP exception thrown: Volume db30254b-aca7-45da-b0a9-bb5772773c01 could not be found. Dec 16 14:38:15.478636 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cca4451b-a4c3-457a-8199-015bd3b6066d tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Returning 404 to user: Volume db30254b-aca7-45da-b0a9-bb5772773c01 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:38:15.479897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cca4451b-a4c3-457a-8199-015bd3b6066d tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 404 len: 109 microversion: 2.1 time: 0.179976 Dec 16 14:38:15.487514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 35/67] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:15 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:38:15.515702 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e2a670f7-d4de-4d60-b10e-6243b9cafa22 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe65fee0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:15.523560 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-05e456f6-703c-4a93-bb9b-83098b2bab86 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:15.542693 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-05e456f6-703c-4a93-bb9b-83098b2bab86 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.342851 Dec 16 14:38:15.543309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 33/68] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:15 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:15.703662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-e2a670f7-d4de-4d60-b10e-6243b9cafa22 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] HTTP exception thrown: Volume db30254b-aca7-45da-b0a9-bb5772773c01 could not be found. Dec 16 14:38:15.704341 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e2a670f7-d4de-4d60-b10e-6243b9cafa22 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Returning 404 to user: Volume db30254b-aca7-45da-b0a9-bb5772773c01 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:38:15.705446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e2a670f7-d4de-4d60-b10e-6243b9cafa22 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 404 len: 109 microversion: 2.1 time: 0.214556 Dec 16 14:38:15.710012 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 36/69] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Dec 16 14:38:15 2021] DELETE /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 109 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:38:15.729235 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-22849d23-dd8e-49e5-8ea2-9452d55bb571 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Calling method '.version_select at 0x7f26fe6cd430>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:15.846913 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-22849d23-dd8e-49e5-8ea2-9452d55bb571 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] HTTP exception thrown: Volume db30254b-aca7-45da-b0a9-bb5772773c01 could not be found. Dec 16 14:38:15.847665 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-22849d23-dd8e-49e5-8ea2-9452d55bb571 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] Returning 404 to user: Volume db30254b-aca7-45da-b0a9-bb5772773c01 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:38:15.848755 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-22849d23-dd8e-49e5-8ea2-9452d55bb571 tempest-VolumesSnapshotsTestJSON-1692069039 tempest-VolumesSnapshotsTestJSON-1692069039-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01" status: 404 len: 109 microversion: 2.1 time: 0.137583 Dec 16 14:38:15.854408 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 34/70] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:15 2021] GET /compute/v2.1/os-volumes/db30254b-aca7-45da-b0a9-bb5772773c01 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:38:16.158249 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e419b410-1c1c-4a0d-87ac-16d292191416 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:16.162009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e419b410-1c1c-4a0d-87ac-16d292191416 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:16.162782 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:16.168978 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:16.202358 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e419b410-1c1c-4a0d-87ac-16d292191416 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:16.207354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e419b410-1c1c-4a0d-87ac-16d292191416 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:16.209773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:16.212852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e419b410-1c1c-4a0d-87ac-16d292191416 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:16.214273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:16.216425 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:16.217494 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:16.217789 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e419b410-1c1c-4a0d-87ac-16d292191416 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:16.553894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:16.569700 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:16.577815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:16.578943 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-34291bb5-3ca5-40c7-837b-72b976bd1c89 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.467832 Dec 16 14:38:16.579931 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 37/71] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:16 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:16.591967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e6dde16d-0079-4aea-98fe-02fefca6cd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:16.592909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e6dde16d-0079-4aea-98fe-02fefca6cd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:16.601966 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e6dde16d-0079-4aea-98fe-02fefca6cd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:16.602797 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e6dde16d-0079-4aea-98fe-02fefca6cd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:16.604268 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e6dde16d-0079-4aea-98fe-02fefca6cd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:16.605122 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e6dde16d-0079-4aea-98fe-02fefca6cd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:16.791557 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e419b410-1c1c-4a0d-87ac-16d292191416 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:16.810714 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e419b410-1c1c-4a0d-87ac-16d292191416 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.688370 Dec 16 14:38:16.811276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 35/72] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:16 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:16.814837 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e6dde16d-0079-4aea-98fe-02fefca6cd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:16.824845 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e6dde16d-0079-4aea-98fe-02fefca6cd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.243594 Dec 16 14:38:16.825636 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 38/73] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:16 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:17.607862 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:17.609067 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:17.617383 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:17.617837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:17.618789 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:17.619075 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:17.748957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:17.769195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:17.775944 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:17.777281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a81bd056-aba8-4022-8cda-422f1cc9fb51 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.180381 Dec 16 14:38:17.777791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 36/74] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:17 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:17.832645 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-58c83236-77be-4350-8eaf-25387bc2b34a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:17.833447 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-58c83236-77be-4350-8eaf-25387bc2b34a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:17.856024 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58c83236-77be-4350-8eaf-25387bc2b34a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:17.856688 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58c83236-77be-4350-8eaf-25387bc2b34a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:17.857614 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58c83236-77be-4350-8eaf-25387bc2b34a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:17.858232 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58c83236-77be-4350-8eaf-25387bc2b34a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:17.864305 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-49a616f5-8108-4603-9ee5-7efa968eb231 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:17.865333 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-49a616f5-8108-4603-9ee5-7efa968eb231 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:17.874827 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-49a616f5-8108-4603-9ee5-7efa968eb231 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:17.875576 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-49a616f5-8108-4603-9ee5-7efa968eb231 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:17.876971 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-49a616f5-8108-4603-9ee5-7efa968eb231 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:17.877778 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-49a616f5-8108-4603-9ee5-7efa968eb231 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:18.036336 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-49a616f5-8108-4603-9ee5-7efa968eb231 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:18.050732 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-49a616f5-8108-4603-9ee5-7efa968eb231 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.202019 Dec 16 14:38:18.051303 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 37/75] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:17 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:18.106860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-58c83236-77be-4350-8eaf-25387bc2b34a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:18.116578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-58c83236-77be-4350-8eaf-25387bc2b34a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.292807 Dec 16 14:38:18.117812 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 39/76] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:17 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:18.698406 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9b54e29f-8ea1-4b95-93ea-dd7ae647ef4f tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Action: 'create', calling method: .version_select at 0x7f26fe6af790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1193952076", "metadata": {"Type": "work"}}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:18.804070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:18.805012 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:18.813222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:18.813461 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:18.814633 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:18.815063 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:18.949220 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:18.964752 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:18.972265 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:18.973382 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-bdb7fc5c-d2dd-4933-8adb-6224519e563e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.180170 Dec 16 14:38:18.973911 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 40/77] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:18 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:38:19.086128 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cdd81321-54b2-4680-b229-334060e9c777 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:19.087751 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cdd81321-54b2-4680-b229-334060e9c777 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:19.129193 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdd81321-54b2-4680-b229-334060e9c777 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:19.130215 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdd81321-54b2-4680-b229-334060e9c777 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:19.131694 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdd81321-54b2-4680-b229-334060e9c777 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:19.132389 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdd81321-54b2-4680-b229-334060e9c777 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:19.221500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9b54e29f-8ea1-4b95-93ea-dd7ae647ef4f tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.704064 Dec 16 14:38:19.222315 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 38/78] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Dec 16 14:38:18 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 706 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 16 14:38:19.234065 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-54a1be70-7d97-4579-8093-30615edc8c6a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:19.234909 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-54a1be70-7d97-4579-8093-30615edc8c6a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:19.244731 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-54a1be70-7d97-4579-8093-30615edc8c6a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:19.245388 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-54a1be70-7d97-4579-8093-30615edc8c6a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:19.246368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-54a1be70-7d97-4579-8093-30615edc8c6a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:19.246930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-54a1be70-7d97-4579-8093-30615edc8c6a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:19.416950 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cdd81321-54b2-4680-b229-334060e9c777 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:19.425942 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cdd81321-54b2-4680-b229-334060e9c777 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.358712 Dec 16 14:38:19.426711 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 41/79] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:19 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:19.441139 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cfac3f08-046b-4cc7-8f5a-bf3e89550146 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Calling method '.version_select at 0x7f26fe64e0d0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:19.547076 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cfac3f08-046b-4cc7-8f5a-bf3e89550146 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85" status: 200 len: 353 microversion: 2.1 time: 0.118779 Dec 16 14:38:19.551096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-54a1be70-7d97-4579-8093-30615edc8c6a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:19.552717 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 42/80] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:19 2021] GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:19.567225 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-54a1be70-7d97-4579-8093-30615edc8c6a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.343682 Dec 16 14:38:19.576485 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 39/81] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:19 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:19.998849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:20.000124 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:20.011253 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:20.011672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:20.012518 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:20.012920 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:20.159358 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:20.175157 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:20.185460 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:20.186702 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3720366c-2fce-44ef-92c3-d3630bd733d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.198586 Dec 16 14:38:20.187321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 43/82] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:19 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:20.459124 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-382085ea-5c3f-4c33-8fb5-aa89d88e35ff tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:20.459799 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-382085ea-5c3f-4c33-8fb5-aa89d88e35ff tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:20.469529 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-382085ea-5c3f-4c33-8fb5-aa89d88e35ff tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:20.469976 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-382085ea-5c3f-4c33-8fb5-aa89d88e35ff tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:20.470787 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-382085ea-5c3f-4c33-8fb5-aa89d88e35ff tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:20.471227 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-382085ea-5c3f-4c33-8fb5-aa89d88e35ff tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:20.566941 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-97989c1d-9b2a-4029-9a04-77dde0d2f786 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Calling method '.version_select at 0x7f26fe5c7e50>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:20.611135 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-382085ea-5c3f-4c33-8fb5-aa89d88e35ff tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:20.622564 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-382085ea-5c3f-4c33-8fb5-aa89d88e35ff tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1241 microversion: 2.1 time: 0.172973 Dec 16 14:38:20.623128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 40/83] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:20 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1241 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:20.636052 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2a6539f7-b286-4c33-8726-5f342589dd3d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:20.636839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2a6539f7-b286-4c33-8726-5f342589dd3d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:20.648197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2a6539f7-b286-4c33-8726-5f342589dd3d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:20.649534 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2a6539f7-b286-4c33-8726-5f342589dd3d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:20.650824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2a6539f7-b286-4c33-8726-5f342589dd3d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:20.651986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2a6539f7-b286-4c33-8726-5f342589dd3d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:20.717039 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-97989c1d-9b2a-4029-9a04-77dde0d2f786 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85" status: 200 len: 353 microversion: 2.1 time: 0.160246 Dec 16 14:38:20.723967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 44/84] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:20 2021] GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:20.935760 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2a6539f7-b286-4c33-8726-5f342589dd3d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:20.946634 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2a6539f7-b286-4c33-8726-5f342589dd3d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.322088 Dec 16 14:38:20.947444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 41/85] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:20 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:21.211597 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:21.212238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:21.221635 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:21.222540 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:21.222933 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:21.223346 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:21.416710 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:21.442760 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:21.456271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:21.459641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a1062c0b-47ac-42be-9859-6f173db3a3da tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1285 microversion: 2.20 time: 0.257182 Dec 16 14:38:21.470874 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 45/86] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:21 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1285 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:21.646363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0cdee759-6a1a-4ded-bb55-2157e95fc8ba tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:21.646981 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0cdee759-6a1a-4ded-bb55-2157e95fc8ba tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:21.655281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0cdee759-6a1a-4ded-bb55-2157e95fc8ba tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:21.655725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0cdee759-6a1a-4ded-bb55-2157e95fc8ba tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:21.656713 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0cdee759-6a1a-4ded-bb55-2157e95fc8ba tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:21.657150 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0cdee759-6a1a-4ded-bb55-2157e95fc8ba tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:21.747654 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-59874183-8c72-43d5-b3ed-34e7e781b491 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Calling method '.version_select at 0x7f26fe5c7430>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:21.832257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0cdee759-6a1a-4ded-bb55-2157e95fc8ba tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:21.843238 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0cdee759-6a1a-4ded-bb55-2157e95fc8ba tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1233 microversion: 2.1 time: 0.206883 Dec 16 14:38:21.854894 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 42/87] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:21 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1233 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:21.902168 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-59874183-8c72-43d5-b3ed-34e7e781b491 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85" status: 200 len: 353 microversion: 2.1 time: 0.173818 Dec 16 14:38:21.902855 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 46/88] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:21 2021] GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85 => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:21.975562 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f3b60b0a-a9e0-4006-955d-843ac6f0229b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:21.976722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f3b60b0a-a9e0-4006-955d-843ac6f0229b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:21.984516 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3b60b0a-a9e0-4006-955d-843ac6f0229b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:21.985200 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3b60b0a-a9e0-4006-955d-843ac6f0229b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:21.986186 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3b60b0a-a9e0-4006-955d-843ac6f0229b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:21.987028 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3b60b0a-a9e0-4006-955d-843ac6f0229b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:22.292468 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f3b60b0a-a9e0-4006-955d-843ac6f0229b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:22.307864 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f3b60b0a-a9e0-4006-955d-843ac6f0229b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.345446 Dec 16 14:38:22.317145 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 43/89] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:21 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:22.507143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:22.512795 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:22.549305 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:22.549913 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:22.551219 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:22.556761 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:22.880940 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f03c3088-9426-4a43-aaa1-77f85615acdd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:22.892748 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f03c3088-9426-4a43-aaa1-77f85615acdd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:22.913018 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f03c3088-9426-4a43-aaa1-77f85615acdd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:22.913742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f03c3088-9426-4a43-aaa1-77f85615acdd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:22.914834 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f03c3088-9426-4a43-aaa1-77f85615acdd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:22.915281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f03c3088-9426-4a43-aaa1-77f85615acdd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:23.075629 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:23.133570 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:23.150435 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:23.151554 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1891fbd7-ce58-4e1c-a9c3-fb809b00aa9c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1333 microversion: 2.20 time: 0.667337 Dec 16 14:38:23.152115 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 47/90] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:22 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1333 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:23.192982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0032dc8d-a494-422e-bcf8-97ffd0a10ba1 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Calling method '.version_select at 0x7f26fe6144c0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:23.455691 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0032dc8d-a494-422e-bcf8-97ffd0a10ba1 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85" status: 200 len: 354 microversion: 2.1 time: 0.288272 Dec 16 14:38:23.456272 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 48/91] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:23 2021] GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85 => generated 354 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:23.485718 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-be6349f4-dac1-4a7d-9a0c-7e8fbc5c346c tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:23.486430 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-be6349f4-dac1-4a7d-9a0c-7e8fbc5c346c tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:23.502388 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be6349f4-dac1-4a7d-9a0c-7e8fbc5c346c tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:23.502977 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be6349f4-dac1-4a7d-9a0c-7e8fbc5c346c tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:23.505010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be6349f4-dac1-4a7d-9a0c-7e8fbc5c346c tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:23.505455 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be6349f4-dac1-4a7d-9a0c-7e8fbc5c346c tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:23.856246 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f03c3088-9426-4a43-aaa1-77f85615acdd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:23.877616 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f03c3088-9426-4a43-aaa1-77f85615acdd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1307 microversion: 2.1 time: 1.020130 Dec 16 14:38:23.883827 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 44/92] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:22 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1307 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:23.909953 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-78d37de3-9a29-4bdf-9e4a-9c9ed7903ccf tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Calling method '.version_select at 0x7f26fe6b3b80>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:24.202244 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-78d37de3-9a29-4bdf-9e4a-9c9ed7903ccf tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85" status: 200 len: 354 microversion: 2.1 time: 0.317712 Dec 16 14:38:24.202962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 45/93] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:23 2021] GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85 => generated 354 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:24.230213 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:24.234276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:24.252233 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:24.257274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:24.260024 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:24.263683 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:24.395866 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-be6349f4-dac1-4a7d-9a0c-7e8fbc5c346c tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:24.408743 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-be6349f4-dac1-4a7d-9a0c-7e8fbc5c346c tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.943651 Dec 16 14:38:24.409616 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 49/94] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:23 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:24.424936 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7773bca9-e266-4b5e-a122-d830f72b5685 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Calling method '.version_select at 0x7f26fe5c7a60>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:24.608894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7773bca9-e266-4b5e-a122-d830f72b5685 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85" status: 202 len: 0 microversion: 2.1 time: 0.197649 Dec 16 14:38:24.609547 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 50/95] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Dec 16 14:38:24 2021] DELETE /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:38:24.643624 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2e076569-f0d0-467e-aa89-e7bf7f96b9b5 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Calling method '.version_select at 0x7f26fe5c7b80>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:24.716704 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:24.767122 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:24.791297 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:24.792434 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a03beb89-d93d-4c16-9544-35a557319138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1339 microversion: 2.20 time: 0.576506 Dec 16 14:38:24.792960 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 46/96] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:24 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1339 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:24.901882 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c5617965-feb5-497f-b9b1-b1797f4b7316 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:24.918155 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c5617965-feb5-497f-b9b1-b1797f4b7316 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:24.927528 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c5617965-feb5-497f-b9b1-b1797f4b7316 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:24.928167 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c5617965-feb5-497f-b9b1-b1797f4b7316 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:24.931400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c5617965-feb5-497f-b9b1-b1797f4b7316 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:24.931996 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c5617965-feb5-497f-b9b1-b1797f4b7316 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:25.016026 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2e076569-f0d0-467e-aa89-e7bf7f96b9b5 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85" status: 200 len: 353 microversion: 2.1 time: 0.401600 Dec 16 14:38:25.017692 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 51/97] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:24 2021] GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85 => generated 353 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:38:25.482936 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3fe6aa71-fe48-4b59-aa64-8264a5035834 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:25.490236 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3fe6aa71-fe48-4b59-aa64-8264a5035834 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:25.544255 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3fe6aa71-fe48-4b59-aa64-8264a5035834 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:25.545043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3fe6aa71-fe48-4b59-aa64-8264a5035834 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:25.560046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3fe6aa71-fe48-4b59-aa64-8264a5035834 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:25.560968 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3fe6aa71-fe48-4b59-aa64-8264a5035834 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:26.026016 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3fe6aa71-fe48-4b59-aa64-8264a5035834 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:26.042883 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3fe6aa71-fe48-4b59-aa64-8264a5035834 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.604890 Dec 16 14:38:26.057040 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 52/98] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:25 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:26.082938 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:26.083895 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:26.099498 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:26.099943 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:26.104175 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:26.106567 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:26.730796 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c5617965-feb5-497f-b9b1-b1797f4b7316 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:26.765340 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c5617965-feb5-497f-b9b1-b1797f4b7316 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 1.873599 Dec 16 14:38:26.766497 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 47/99] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:24 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:26.784474 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bea7c5a2-5891-4d07-80fd-adf68c042591 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Calling method '.version_select at 0x7f26fe6af700>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:26.787994 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:26.822135 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:26.839209 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:26.840331 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ba682eb3-0577-4f7a-935b-a5045f6bf0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.782219 Dec 16 14:38:26.840891 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 53/100] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:26 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:26.897892 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-bea7c5a2-5891-4d07-80fd-adf68c042591 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] HTTP exception thrown: Volume c8398259-77d1-4a85-b650-80070b512f85 could not be found. Dec 16 14:38:26.898616 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bea7c5a2-5891-4d07-80fd-adf68c042591 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] Returning 404 to user: Volume c8398259-77d1-4a85-b650-80070b512f85 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:38:26.899870 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-bea7c5a2-5891-4d07-80fd-adf68c042591 tempest-VolumesGetTestJSON-744573104 tempest-VolumesGetTestJSON-744573104-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85" status: 404 len: 109 microversion: 2.1 time: 0.129827 Dec 16 14:38:26.900444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 48/101] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:38:26 2021] GET /compute/v2.1/os-volumes/c8398259-77d1-4a85-b650-80070b512f85 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:38:27.067763 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-80abe2a8-f303-4b63-8c95-edc9cd2bc766 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:27.068392 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-80abe2a8-f303-4b63-8c95-edc9cd2bc766 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:27.078159 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80abe2a8-f303-4b63-8c95-edc9cd2bc766 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:27.078925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80abe2a8-f303-4b63-8c95-edc9cd2bc766 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:27.079875 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80abe2a8-f303-4b63-8c95-edc9cd2bc766 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:27.080434 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80abe2a8-f303-4b63-8c95-edc9cd2bc766 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:27.349682 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-80abe2a8-f303-4b63-8c95-edc9cd2bc766 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:27.369263 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-80abe2a8-f303-4b63-8c95-edc9cd2bc766 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.313176 Dec 16 14:38:27.371323 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 54/102] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:27 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:27.715849 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-5d9f81c4-a834-4d1d-9229-3e3b1de4ad87 req-c0065ba9-efc4-471c-951a-5d2a8618d7fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d728139-ef79-4b38-b489-6fd9aa84d0fa", "tag": "c97c5936-fff0-4630-886d-e693f3707c42"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:27.723512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:38:27.723512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:38:27.733204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5d9f81c4-a834-4d1d-9229-3e3b1de4ad87 req-c0065ba9-efc4-471c-951a-5d2a8618d7fd service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:27.733850 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5d9f81c4-a834-4d1d-9229-3e3b1de4ad87 req-c0065ba9-efc4-471c-951a-5d2a8618d7fd service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:27.758882 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-5d9f81c4-a834-4d1d-9229-3e3b1de4ad87 req-c0065ba9-efc4-471c-951a-5d2a8618d7fd service nova] Creating event network-changed:c97c5936-fff0-4630-886d-e693f3707c42 for instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa on hv-cinder-82189 Dec 16 14:38:27.759403 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5d9f81c4-a834-4d1d-9229-3e3b1de4ad87 req-c0065ba9-efc4-471c-951a-5d2a8618d7fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=96670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 14:38:27.760562 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cedcb210-f5b3-487b-a569-39cc78f232be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:27.760986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cedcb210-f5b3-487b-a569-39cc78f232be None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:27.761962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cedcb210-f5b3-487b-a569-39cc78f232be None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:27.762418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cedcb210-f5b3-487b-a569-39cc78f232be None None] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:27.771159 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.compute.rpcapi [None req-cedcb210-f5b3-487b-a569-39cc78f232be None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 16 14:38:27.772048 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cedcb210-f5b3-487b-a569-39cc78f232be None None] Releasing lock "compute-rpcapi-router" {{(pid=96670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 14:38:27.793914 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5b9ccd1b-961f-4e6e-a451-73131d0ea27d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:27.794575 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5b9ccd1b-961f-4e6e-a451-73131d0ea27d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:27.798724 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cedcb210-f5b3-487b-a569-39cc78f232be None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214541 Dec 16 14:38:27.803438 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 49/103] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:38:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:27.815136 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b9ccd1b-961f-4e6e-a451-73131d0ea27d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:27.815592 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b9ccd1b-961f-4e6e-a451-73131d0ea27d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:27.816396 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b9ccd1b-961f-4e6e-a451-73131d0ea27d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:27.817001 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b9ccd1b-961f-4e6e-a451-73131d0ea27d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:27.867452 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:27.868391 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:27.876518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:27.877429 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:27.878388 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:27.878968 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:28.303996 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:28.305031 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5b9ccd1b-961f-4e6e-a451-73131d0ea27d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:28.331776 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5b9ccd1b-961f-4e6e-a451-73131d0ea27d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.552367 Dec 16 14:38:28.335693 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 55/104] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:27 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:28.340920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:28.349474 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:28.351079 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-afc4bd49-09dd-4dcc-b5b6-e319f5113e44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.494391 Dec 16 14:38:28.352583 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 50/105] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:27 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:28.393812 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-549fc45f-0f24-45e1-a14f-88de037036f7 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:28.394844 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-549fc45f-0f24-45e1-a14f-88de037036f7 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:28.405233 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-549fc45f-0f24-45e1-a14f-88de037036f7 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:28.406017 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-549fc45f-0f24-45e1-a14f-88de037036f7 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:28.407046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-549fc45f-0f24-45e1-a14f-88de037036f7 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:28.407719 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-549fc45f-0f24-45e1-a14f-88de037036f7 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:28.652778 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-549fc45f-0f24-45e1-a14f-88de037036f7 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:28.664482 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-549fc45f-0f24-45e1-a14f-88de037036f7 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.280390 Dec 16 14:38:28.668405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 56/106] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:28 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:29.371546 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ffc3254b-85e5-488d-9220-22602a08e649 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:29.373032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ffc3254b-85e5-488d-9220-22602a08e649 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:29.377577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:29.378256 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:29.386649 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ffc3254b-85e5-488d-9220-22602a08e649 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:29.387408 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ffc3254b-85e5-488d-9220-22602a08e649 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:29.388410 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ffc3254b-85e5-488d-9220-22602a08e649 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:29.390535 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ffc3254b-85e5-488d-9220-22602a08e649 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:29.401326 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:29.402265 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:29.403293 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:29.403965 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:29.709304 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ffc3254b-85e5-488d-9220-22602a08e649 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:29.720615 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ffc3254b-85e5-488d-9220-22602a08e649 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.364923 Dec 16 14:38:29.721974 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 51/107] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:29 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:29.733067 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-06312d92-eb9d-4a00-946d-93808da56060 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:29.733939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-06312d92-eb9d-4a00-946d-93808da56060 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:29.742339 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-06312d92-eb9d-4a00-946d-93808da56060 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:29.743117 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-06312d92-eb9d-4a00-946d-93808da56060 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:29.744077 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-06312d92-eb9d-4a00-946d-93808da56060 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:29.744499 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-06312d92-eb9d-4a00-946d-93808da56060 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:30.024082 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-06312d92-eb9d-4a00-946d-93808da56060 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:30.034267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-06312d92-eb9d-4a00-946d-93808da56060 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.310843 Dec 16 14:38:30.034822 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 52/108] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:29 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:30.305672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:30.321806 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:30.328931 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:30.330495 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9214c425-3c54-485d-be08-847a8596026f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.963198 Dec 16 14:38:30.330982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 57/109] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:29 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:30.532139 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-2c4aa194-d76c-4f4c-bbac-fa1ce308719f req-e18bed4d-0c74-4489-b677-c4432e9b8087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5b5c02-69ca-4290-bba0-54d6ed2eb215", "tag": "e59517d2-2291-4c73-889e-594d9cc076e2"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:30.541439 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:38:30.541439 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:38:30.558983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-2c4aa194-d76c-4f4c-bbac-fa1ce308719f req-e18bed4d-0c74-4489-b677-c4432e9b8087 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:30.559427 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-2c4aa194-d76c-4f4c-bbac-fa1ce308719f req-e18bed4d-0c74-4489-b677-c4432e9b8087 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:30.633425 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-2c4aa194-d76c-4f4c-bbac-fa1ce308719f req-e18bed4d-0c74-4489-b677-c4432e9b8087 service nova] Creating event network-changed:e59517d2-2291-4c73-889e-594d9cc076e2 for instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 on hv-cinder-82189 Dec 16 14:38:30.651137 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-2c4aa194-d76c-4f4c-bbac-fa1ce308719f req-e18bed4d-0c74-4489-b677-c4432e9b8087 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134797 Dec 16 14:38:30.652944 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 53/110] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:30.751956 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8967fc7b-2a62-4ad8-a501-a853bbf8504c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:30.752648 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8967fc7b-2a62-4ad8-a501-a853bbf8504c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:30.775423 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8967fc7b-2a62-4ad8-a501-a853bbf8504c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:30.776119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8967fc7b-2a62-4ad8-a501-a853bbf8504c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:30.777817 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8967fc7b-2a62-4ad8-a501-a853bbf8504c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:30.778582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8967fc7b-2a62-4ad8-a501-a853bbf8504c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:31.057946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cb1d7294-d61d-4641-a6c8-e7dbcff25634 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:31.058943 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cb1d7294-d61d-4641-a6c8-e7dbcff25634 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:31.067008 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cb1d7294-d61d-4641-a6c8-e7dbcff25634 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:31.067672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cb1d7294-d61d-4641-a6c8-e7dbcff25634 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:31.068808 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cb1d7294-d61d-4641-a6c8-e7dbcff25634 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:31.069385 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cb1d7294-d61d-4641-a6c8-e7dbcff25634 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:31.467150 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8967fc7b-2a62-4ad8-a501-a853bbf8504c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:31.515071 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8967fc7b-2a62-4ad8-a501-a853bbf8504c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.774884 Dec 16 14:38:31.521364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 58/111] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:30 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:31.538578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:31.539348 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:31.563558 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:31.564086 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:31.564916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:31.565441 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:31.704207 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cb1d7294-d61d-4641-a6c8-e7dbcff25634 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:31.720280 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cb1d7294-d61d-4641-a6c8-e7dbcff25634 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.672097 Dec 16 14:38:31.720866 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 54/112] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:31 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:31.979624 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:31.997068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:32.018653 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:32.021379 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-22c4b59d-192f-4466-a23f-8761754225bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.498829 Dec 16 14:38:32.025577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 59/113] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:31 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:32.542481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-dba9ce74-1fcf-46ac-ae78-f33a37a8f005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:32.543080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-dba9ce74-1fcf-46ac-ae78-f33a37a8f005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:32.551158 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dba9ce74-1fcf-46ac-ae78-f33a37a8f005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:32.551870 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dba9ce74-1fcf-46ac-ae78-f33a37a8f005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:32.552799 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dba9ce74-1fcf-46ac-ae78-f33a37a8f005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:32.553424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dba9ce74-1fcf-46ac-ae78-f33a37a8f005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:32.744581 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6379712e-a192-4a50-9446-71e221fb7f95 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:32.745479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6379712e-a192-4a50-9446-71e221fb7f95 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:32.756732 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6379712e-a192-4a50-9446-71e221fb7f95 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:32.757421 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6379712e-a192-4a50-9446-71e221fb7f95 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:32.759214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6379712e-a192-4a50-9446-71e221fb7f95 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:32.759798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6379712e-a192-4a50-9446-71e221fb7f95 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:32.999519 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-dba9ce74-1fcf-46ac-ae78-f33a37a8f005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:33.010163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-dba9ce74-1fcf-46ac-ae78-f33a37a8f005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.477422 Dec 16 14:38:33.020544 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 55/114] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:32 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:33.062391 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:33.063270 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:33.066756 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6379712e-a192-4a50-9446-71e221fb7f95 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:33.073259 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:33.073908 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:33.075242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:33.075793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:33.085712 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6379712e-a192-4a50-9446-71e221fb7f95 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.351309 Dec 16 14:38:33.087725 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 60/115] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:32 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:33.360142 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:33.384528 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:33.391744 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:33.393018 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0ea103db-2437-425a-a35d-c440a993b216 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.352562 Dec 16 14:38:33.393884 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 56/116] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:33 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:34.037214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f5368a75-060c-43a9-a575-5d7db7307657 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:34.037848 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f5368a75-060c-43a9-a575-5d7db7307657 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:34.046788 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f5368a75-060c-43a9-a575-5d7db7307657 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:34.047490 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f5368a75-060c-43a9-a575-5d7db7307657 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:34.048271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f5368a75-060c-43a9-a575-5d7db7307657 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:34.048839 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f5368a75-060c-43a9-a575-5d7db7307657 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:34.122722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4cba3d75-5115-4f01-a2e5-00a75aa7ec5e tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:34.124003 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4cba3d75-5115-4f01-a2e5-00a75aa7ec5e tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:34.148640 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4cba3d75-5115-4f01-a2e5-00a75aa7ec5e tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:34.150732 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4cba3d75-5115-4f01-a2e5-00a75aa7ec5e tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:34.154990 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4cba3d75-5115-4f01-a2e5-00a75aa7ec5e tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:34.156505 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4cba3d75-5115-4f01-a2e5-00a75aa7ec5e tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:34.369221 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f5368a75-060c-43a9-a575-5d7db7307657 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:34.380984 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f5368a75-060c-43a9-a575-5d7db7307657 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.357014 Dec 16 14:38:34.391647 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 61/117] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:34 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:34.417590 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:34.418475 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:34.426441 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:34.427120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:34.428072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:34.428652 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:34.442285 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4cba3d75-5115-4f01-a2e5-00a75aa7ec5e tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:34.453146 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4cba3d75-5115-4f01-a2e5-00a75aa7ec5e tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.352587 Dec 16 14:38:34.454056 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 57/118] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:34 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:34.678779 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:34.707800 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:34.714844 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:34.715966 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d4fd9536-0679-477b-83ce-e00b58ee7536 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.308486 Dec 16 14:38:34.716519 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 62/119] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:34 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:35.407933 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4acd3d68-1ce7-48b2-8ec3-5e60cf376c70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:35.408802 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4acd3d68-1ce7-48b2-8ec3-5e60cf376c70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:35.417715 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4acd3d68-1ce7-48b2-8ec3-5e60cf376c70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:35.418307 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4acd3d68-1ce7-48b2-8ec3-5e60cf376c70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:35.423979 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4acd3d68-1ce7-48b2-8ec3-5e60cf376c70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:35.424428 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4acd3d68-1ce7-48b2-8ec3-5e60cf376c70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:35.486644 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fee77fc9-4726-4a71-a3e4-494161dc2a5d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:35.487321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fee77fc9-4726-4a71-a3e4-494161dc2a5d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:35.495885 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fee77fc9-4726-4a71-a3e4-494161dc2a5d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:35.496369 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fee77fc9-4726-4a71-a3e4-494161dc2a5d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:35.497167 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fee77fc9-4726-4a71-a3e4-494161dc2a5d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:35.497603 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fee77fc9-4726-4a71-a3e4-494161dc2a5d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:35.692300 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4acd3d68-1ce7-48b2-8ec3-5e60cf376c70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:35.700742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4acd3d68-1ce7-48b2-8ec3-5e60cf376c70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.306294 Dec 16 14:38:35.701286 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 58/120] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:35 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:35.742116 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:35.742947 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:35.752101 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:35.752547 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:35.753398 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:35.753833 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:35.783070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fee77fc9-4726-4a71-a3e4-494161dc2a5d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:35.792422 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fee77fc9-4726-4a71-a3e4-494161dc2a5d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.315710 Dec 16 14:38:35.793018 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 63/121] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:35 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:35.978507 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:35.992896 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:35.999225 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:36.000277 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3e01c601-a969-4b26-bf8f-556405b598d1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.268312 Dec 16 14:38:36.000818 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 59/122] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:35 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:36.723099 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7c832e62-6505-4970-b951-148d0629924b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:36.723746 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7c832e62-6505-4970-b951-148d0629924b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:36.731987 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c832e62-6505-4970-b951-148d0629924b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:36.732427 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c832e62-6505-4970-b951-148d0629924b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:36.733196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c832e62-6505-4970-b951-148d0629924b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:36.733622 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c832e62-6505-4970-b951-148d0629924b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:36.816426 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7cf5ed2c-70a0-4fec-9253-93c934bd8c1b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:36.817070 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7cf5ed2c-70a0-4fec-9253-93c934bd8c1b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:36.825488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7cf5ed2c-70a0-4fec-9253-93c934bd8c1b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:36.825946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7cf5ed2c-70a0-4fec-9253-93c934bd8c1b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:36.826749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7cf5ed2c-70a0-4fec-9253-93c934bd8c1b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:36.827170 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7cf5ed2c-70a0-4fec-9253-93c934bd8c1b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:36.944333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7c832e62-6505-4970-b951-148d0629924b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:36.953790 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7c832e62-6505-4970-b951-148d0629924b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.240622 Dec 16 14:38:36.954399 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 64/123] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:36 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:37.023444 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:37.024153 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:37.031975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:37.032419 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:37.033511 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:37.033955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:37.067453 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7cf5ed2c-70a0-4fec-9253-93c934bd8c1b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:37.076984 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7cf5ed2c-70a0-4fec-9253-93c934bd8c1b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.270317 Dec 16 14:38:37.077624 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 60/124] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:36 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:37.264499 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:37.279856 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:37.286565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:37.287992 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9ee668ec-502e-4856-9224-f13d12431690 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.274090 Dec 16 14:38:37.288567 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 65/125] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:37 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:38:37.713761 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-77778eaa-d903-495a-a7c7-1e16a0920a55 req-3d50e795-35b3-4877-bcea-6c74213901fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4cf5bc-8f2b-4e78-93cd-a3097aa16030", "name": "network-vif-plugged", "status": "completed", "tag": "4288c836-920e-4dde-9566-78d211f0412e"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:37.720897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:38:37.720897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:38:37.730326 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-77778eaa-d903-495a-a7c7-1e16a0920a55 req-3d50e795-35b3-4877-bcea-6c74213901fa service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:37.730772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-77778eaa-d903-495a-a7c7-1e16a0920a55 req-3d50e795-35b3-4877-bcea-6c74213901fa service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:37.749625 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-77778eaa-d903-495a-a7c7-1e16a0920a55 req-3d50e795-35b3-4877-bcea-6c74213901fa service nova] Creating event network-vif-plugged:4288c836-920e-4dde-9566-78d211f0412e for instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 on hv-cinder-82189 Dec 16 14:38:37.754405 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-77778eaa-d903-495a-a7c7-1e16a0920a55 req-3d50e795-35b3-4877-bcea-6c74213901fa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132782 Dec 16 14:38:37.755003 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 61/126] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:37.980528 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-47b4ac28-8d67-4b2d-aa43-22105ab3ed7a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:37.981184 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-47b4ac28-8d67-4b2d-aa43-22105ab3ed7a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:37.990473 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-47b4ac28-8d67-4b2d-aa43-22105ab3ed7a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:37.991049 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-47b4ac28-8d67-4b2d-aa43-22105ab3ed7a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:37.991891 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-47b4ac28-8d67-4b2d-aa43-22105ab3ed7a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:37.992361 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-47b4ac28-8d67-4b2d-aa43-22105ab3ed7a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:38.105245 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-519c114f-282c-43a0-86f4-14317f783685 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:38.106366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-519c114f-282c-43a0-86f4-14317f783685 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:38.114611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-519c114f-282c-43a0-86f4-14317f783685 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:38.115069 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-519c114f-282c-43a0-86f4-14317f783685 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:38.115879 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-519c114f-282c-43a0-86f4-14317f783685 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:38.116318 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-519c114f-282c-43a0-86f4-14317f783685 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:38.291956 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-47b4ac28-8d67-4b2d-aa43-22105ab3ed7a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:38.306426 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-47b4ac28-8d67-4b2d-aa43-22105ab3ed7a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.337795 Dec 16 14:38:38.307271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 66/127] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:37 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:38.321621 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:38.322212 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:38.329777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:38.330278 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:38.331067 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:38.331500 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:38.356981 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-519c114f-282c-43a0-86f4-14317f783685 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:38.366511 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-519c114f-282c-43a0-86f4-14317f783685 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.275906 Dec 16 14:38:38.367876 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 62/128] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:38 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:38.555521 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:38.572188 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:38.578793 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:38.579960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-30001247-b600-4e26-8265-0fc2b8b6dc65 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.271783 Dec 16 14:38:38.580504 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 67/129] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:38 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:39.329543 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d1b4c376-762e-4be5-9e81-2408571ac7af tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:39.330229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d1b4c376-762e-4be5-9e81-2408571ac7af tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:39.339100 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1b4c376-762e-4be5-9e81-2408571ac7af tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:39.339540 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1b4c376-762e-4be5-9e81-2408571ac7af tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:39.340332 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1b4c376-762e-4be5-9e81-2408571ac7af tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:39.340774 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1b4c376-762e-4be5-9e81-2408571ac7af tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:39.390859 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a56f40f3-2518-4c4f-b260-a74052455515 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:39.391749 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a56f40f3-2518-4c4f-b260-a74052455515 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:39.399587 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a56f40f3-2518-4c4f-b260-a74052455515 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:39.400245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a56f40f3-2518-4c4f-b260-a74052455515 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:39.401380 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a56f40f3-2518-4c4f-b260-a74052455515 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:39.401963 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a56f40f3-2518-4c4f-b260-a74052455515 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:39.606026 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d1b4c376-762e-4be5-9e81-2408571ac7af tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:39.621367 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d1b4c376-762e-4be5-9e81-2408571ac7af tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.301196 Dec 16 14:38:39.622484 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 63/130] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:39 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:39.637664 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:39.638309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:39.646450 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:39.646892 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:39.647669 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:39.648114 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:39.664697 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a56f40f3-2518-4c4f-b260-a74052455515 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:39.674114 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a56f40f3-2518-4c4f-b260-a74052455515 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.293312 Dec 16 14:38:39.675019 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 68/131] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:39 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:39.944248 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:39.995508 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:40.007790 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:40.012004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ac55f31b-a505-4055-b230-fc8e63969ed0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.385465 Dec 16 14:38:40.014479 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 64/132] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:39 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:40.645655 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-93079a97-b6b6-4795-94d5-8d2b30af6af9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:40.646633 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-93079a97-b6b6-4795-94d5-8d2b30af6af9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:40.654475 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-93079a97-b6b6-4795-94d5-8d2b30af6af9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:40.654944 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-93079a97-b6b6-4795-94d5-8d2b30af6af9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:40.655760 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-93079a97-b6b6-4795-94d5-8d2b30af6af9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:40.657143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-93079a97-b6b6-4795-94d5-8d2b30af6af9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:40.698800 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b94c4980-87ef-4b17-97de-7b43978842fc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:40.699435 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b94c4980-87ef-4b17-97de-7b43978842fc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:40.708045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b94c4980-87ef-4b17-97de-7b43978842fc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:40.708487 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b94c4980-87ef-4b17-97de-7b43978842fc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:40.709350 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b94c4980-87ef-4b17-97de-7b43978842fc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:40.709812 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b94c4980-87ef-4b17-97de-7b43978842fc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:40.888355 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-93079a97-b6b6-4795-94d5-8d2b30af6af9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:40.897276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-93079a97-b6b6-4795-94d5-8d2b30af6af9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.261258 Dec 16 14:38:40.897841 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 69/133] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:40 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:40.942503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b94c4980-87ef-4b17-97de-7b43978842fc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:40.952153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b94c4980-87ef-4b17-97de-7b43978842fc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.263468 Dec 16 14:38:40.952776 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 65/134] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:40 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:41.042629 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:41.043246 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:41.051371 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:41.051739 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:41.052461 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:41.052892 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:41.393974 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:41.414066 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:41.421456 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:41.422643 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b34cdadf-1415-47ed-b728-5ce0562ee441 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.390207 Dec 16 14:38:41.423517 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 70/135] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:41 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:41.924692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-dee8bb2f-a2d3-427b-a515-5660c514db71 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:41.926779 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-dee8bb2f-a2d3-427b-a515-5660c514db71 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:41.939107 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dee8bb2f-a2d3-427b-a515-5660c514db71 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:41.939878 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dee8bb2f-a2d3-427b-a515-5660c514db71 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:41.941046 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dee8bb2f-a2d3-427b-a515-5660c514db71 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:41.942159 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dee8bb2f-a2d3-427b-a515-5660c514db71 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:41.984343 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-80d353b3-2d9b-4be2-ae05-85e608d6833b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:41.986417 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-80d353b3-2d9b-4be2-ae05-85e608d6833b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:42.016777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80d353b3-2d9b-4be2-ae05-85e608d6833b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:42.026790 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80d353b3-2d9b-4be2-ae05-85e608d6833b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:42.028000 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80d353b3-2d9b-4be2-ae05-85e608d6833b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:42.028438 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80d353b3-2d9b-4be2-ae05-85e608d6833b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:42.351299 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-dee8bb2f-a2d3-427b-a515-5660c514db71 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:42.361405 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-dee8bb2f-a2d3-427b-a515-5660c514db71 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.450576 Dec 16 14:38:42.368408 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 66/136] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:41 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:42.405358 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-80d353b3-2d9b-4be2-ae05-85e608d6833b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:42.417851 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-80d353b3-2d9b-4be2-ae05-85e608d6833b tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.452822 Dec 16 14:38:42.419036 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 71/137] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:41 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:42.457745 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:42.458500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:42.479641 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:42.480093 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:42.480890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:42.481316 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:42.919230 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:42.970661 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:42.984312 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:42.989067 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-58befc8f-b540-42d8-8fc1-382b998e25a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.552119 Dec 16 14:38:42.989691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 67/138] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:42 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:43.395095 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f4b3a548-f55e-4287-a7f8-93126d19534e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:43.406490 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f4b3a548-f55e-4287-a7f8-93126d19534e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:43.420220 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f4b3a548-f55e-4287-a7f8-93126d19534e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:43.421867 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f4b3a548-f55e-4287-a7f8-93126d19534e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:43.423347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f4b3a548-f55e-4287-a7f8-93126d19534e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:43.424258 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f4b3a548-f55e-4287-a7f8-93126d19534e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:43.468919 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f7da6a57-51b1-4f63-847a-31b334c8ead5 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:43.470207 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f7da6a57-51b1-4f63-847a-31b334c8ead5 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:43.501599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7da6a57-51b1-4f63-847a-31b334c8ead5 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:43.502067 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7da6a57-51b1-4f63-847a-31b334c8ead5 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:43.510548 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7da6a57-51b1-4f63-847a-31b334c8ead5 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:43.510996 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7da6a57-51b1-4f63-847a-31b334c8ead5 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:43.815657 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f7da6a57-51b1-4f63-847a-31b334c8ead5 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:43.844418 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f4b3a548-f55e-4287-a7f8-93126d19534e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:43.853083 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f7da6a57-51b1-4f63-847a-31b334c8ead5 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.414674 Dec 16 14:38:43.862471 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 68/139] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:43 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:43.870865 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f4b3a548-f55e-4287-a7f8-93126d19534e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.494979 Dec 16 14:38:43.871909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 72/140] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:43 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:44.020701 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:44.021419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:44.031055 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:44.032507 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:44.033808 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:44.034670 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:44.355148 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:44.373013 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:44.380553 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:44.381656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3e7a59fd-ff9a-4f18-8a93-ad1281de7071 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.377105 Dec 16 14:38:44.382532 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 69/141] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:44 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:44.873131 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-e3dfa70d-28cc-476c-8a03-fde72fe90278 req-3ccf9636-f5c9-4506-b636-715bc90150db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b5c02-69ca-4290-bba0-54d6ed2eb215", "name": "network-vif-plugged", "status": "completed", "tag": "e59517d2-2291-4c73-889e-594d9cc076e2"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:44.883729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:38:44.883729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:38:44.895032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b55785d3-8476-4acf-9070-07336194fedb tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:44.895978 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b55785d3-8476-4acf-9070-07336194fedb tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:44.903678 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-e3dfa70d-28cc-476c-8a03-fde72fe90278 req-3ccf9636-f5c9-4506-b636-715bc90150db service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:44.904226 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-e3dfa70d-28cc-476c-8a03-fde72fe90278 req-3ccf9636-f5c9-4506-b636-715bc90150db service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:44.912589 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b55785d3-8476-4acf-9070-07336194fedb tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:44.913664 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b55785d3-8476-4acf-9070-07336194fedb tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:44.915768 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b55785d3-8476-4acf-9070-07336194fedb tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:44.916881 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b55785d3-8476-4acf-9070-07336194fedb tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:44.935966 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-e3dfa70d-28cc-476c-8a03-fde72fe90278 req-3ccf9636-f5c9-4506-b636-715bc90150db service nova] Creating event network-vif-plugged:e59517d2-2291-4c73-889e-594d9cc076e2 for instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 on hv-cinder-82189 Dec 16 14:38:44.944353 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-e3dfa70d-28cc-476c-8a03-fde72fe90278 req-3ccf9636-f5c9-4506-b636-715bc90150db service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085595 Dec 16 14:38:44.945215 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 73/142] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:38:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:44.961421 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-09272c23-a979-4f99-b332-461cf1f86092 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:44.963877 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-09272c23-a979-4f99-b332-461cf1f86092 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:44.980298 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-09272c23-a979-4f99-b332-461cf1f86092 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:44.981042 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-09272c23-a979-4f99-b332-461cf1f86092 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:44.982332 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-09272c23-a979-4f99-b332-461cf1f86092 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:44.982900 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-09272c23-a979-4f99-b332-461cf1f86092 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:45.453533 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b55785d3-8476-4acf-9070-07336194fedb tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:45.464707 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b55785d3-8476-4acf-9070-07336194fedb tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.596625 Dec 16 14:38:45.474479 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 70/143] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:44 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:45.485689 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:45.486598 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:45.496670 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:45.497354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:45.498349 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:45.499281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:45.664154 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-09272c23-a979-4f99-b332-461cf1f86092 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:45.705114 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-09272c23-a979-4f99-b332-461cf1f86092 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.754078 Dec 16 14:38:45.709120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 74/144] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:44 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:46.137078 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:46.167560 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:46.181556 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:46.183640 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-337a99c4-dd9c-43ea-8ae8-d1b6cb19d5c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.707529 Dec 16 14:38:46.195506 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 71/145] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:45 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:46.490129 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f21b12ae-e053-46fe-92d6-d0b7e0a9b962 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:46.490773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f21b12ae-e053-46fe-92d6-d0b7e0a9b962 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:46.499991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f21b12ae-e053-46fe-92d6-d0b7e0a9b962 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:46.500485 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f21b12ae-e053-46fe-92d6-d0b7e0a9b962 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:46.501489 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f21b12ae-e053-46fe-92d6-d0b7e0a9b962 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:46.501926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f21b12ae-e053-46fe-92d6-d0b7e0a9b962 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:46.761067 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5701fc51-edbb-4ec5-92a5-3e417e7e7ca5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:46.763430 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5701fc51-edbb-4ec5-92a5-3e417e7e7ca5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:46.787730 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5701fc51-edbb-4ec5-92a5-3e417e7e7ca5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:46.788577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5701fc51-edbb-4ec5-92a5-3e417e7e7ca5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:46.789585 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5701fc51-edbb-4ec5-92a5-3e417e7e7ca5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:46.793542 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5701fc51-edbb-4ec5-92a5-3e417e7e7ca5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:47.094523 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5701fc51-edbb-4ec5-92a5-3e417e7e7ca5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:47.105219 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5701fc51-edbb-4ec5-92a5-3e417e7e7ca5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.370570 Dec 16 14:38:47.106306 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 72/146] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:46 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:47.242684 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:47.246369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:47.262698 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f21b12ae-e053-46fe-92d6-d0b7e0a9b962 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:47.263022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:47.263258 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:47.267550 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:47.272379 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:47.296008 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f21b12ae-e053-46fe-92d6-d0b7e0a9b962 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.817170 Dec 16 14:38:47.309038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 75/147] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:46 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:47.727128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:47.744131 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:47.751385 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:47.752505 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-09a47e40-d906-4380-b88e-fb8a561e45a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.542651 Dec 16 14:38:47.753057 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 73/148] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:47 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:38:48.143911 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-41d40a30-206c-443a-b6f6-4f485ab8b072 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:48.146409 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-41d40a30-206c-443a-b6f6-4f485ab8b072 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:48.165775 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41d40a30-206c-443a-b6f6-4f485ab8b072 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:48.167715 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41d40a30-206c-443a-b6f6-4f485ab8b072 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:48.169033 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41d40a30-206c-443a-b6f6-4f485ab8b072 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:48.173079 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41d40a30-206c-443a-b6f6-4f485ab8b072 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:48.372347 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-94f74d00-aecb-4f0d-aad7-5f2f867ff4f4 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:48.374442 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-94f74d00-aecb-4f0d-aad7-5f2f867ff4f4 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:48.400635 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-94f74d00-aecb-4f0d-aad7-5f2f867ff4f4 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:48.402084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-94f74d00-aecb-4f0d-aad7-5f2f867ff4f4 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:48.403186 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-94f74d00-aecb-4f0d-aad7-5f2f867ff4f4 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:48.404044 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-94f74d00-aecb-4f0d-aad7-5f2f867ff4f4 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:48.657802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-41d40a30-206c-443a-b6f6-4f485ab8b072 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:48.668434 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-41d40a30-206c-443a-b6f6-4f485ab8b072 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.542795 Dec 16 14:38:48.669487 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 76/149] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:48 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:48.781497 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:48.782017 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:48.790522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:48.791293 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:48.792292 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:48.793165 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:48.803106 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-94f74d00-aecb-4f0d-aad7-5f2f867ff4f4 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:48.815806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-94f74d00-aecb-4f0d-aad7-5f2f867ff4f4 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.489772 Dec 16 14:38:48.828383 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 74/150] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:48 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:49.101639 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:49.151843 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:49.182116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:49.184093 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-77ee4885-3c1e-469c-95c2-6170c943f190 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.416027 Dec 16 14:38:49.198224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 77/151] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:48 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:38:49.699565 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9c6f31fa-477a-49fb-a1f5-a1a2098d25f2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:49.700736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9c6f31fa-477a-49fb-a1f5-a1a2098d25f2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:49.714139 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9c6f31fa-477a-49fb-a1f5-a1a2098d25f2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:49.715302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9c6f31fa-477a-49fb-a1f5-a1a2098d25f2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:49.716251 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9c6f31fa-477a-49fb-a1f5-a1a2098d25f2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:49.716863 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9c6f31fa-477a-49fb-a1f5-a1a2098d25f2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:49.856028 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2394cc50-f223-4035-ae4e-cd7e8c1f329a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:49.857508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2394cc50-f223-4035-ae4e-cd7e8c1f329a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:49.874520 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2394cc50-f223-4035-ae4e-cd7e8c1f329a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:49.875814 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2394cc50-f223-4035-ae4e-cd7e8c1f329a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:49.877479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2394cc50-f223-4035-ae4e-cd7e8c1f329a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:49.878485 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2394cc50-f223-4035-ae4e-cd7e8c1f329a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:50.050989 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9c6f31fa-477a-49fb-a1f5-a1a2098d25f2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:50.089492 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9c6f31fa-477a-49fb-a1f5-a1a2098d25f2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.399554 Dec 16 14:38:50.096491 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 75/152] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:49 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:38:50.232586 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:50.233661 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:50.250173 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:50.251612 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:50.253905 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:50.254873 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:50.320542 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2394cc50-f223-4035-ae4e-cd7e8c1f329a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:50.337812 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2394cc50-f223-4035-ae4e-cd7e8c1f329a tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1314 microversion: 2.1 time: 0.504801 Dec 16 14:38:50.339819 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 78/153] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:49 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:50.651919 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:50.680757 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:50.695702 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:50.697855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ea72ab62-1661-458a-81d2-6e6f47a95d12 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.488437 Dec 16 14:38:50.698948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 76/154] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:50 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:38:51.131580 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f66e81b1-3d78-4e26-9090-d26ede77e44d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:51.133471 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f66e81b1-3d78-4e26-9090-d26ede77e44d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:51.143669 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f66e81b1-3d78-4e26-9090-d26ede77e44d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:51.144413 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f66e81b1-3d78-4e26-9090-d26ede77e44d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:51.146004 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f66e81b1-3d78-4e26-9090-d26ede77e44d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:51.146650 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f66e81b1-3d78-4e26-9090-d26ede77e44d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:51.375672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4c1ce5b0-915d-4367-b0b9-e2d1d5f28ed1 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:51.376917 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4c1ce5b0-915d-4367-b0b9-e2d1d5f28ed1 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:51.393628 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c1ce5b0-915d-4367-b0b9-e2d1d5f28ed1 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:51.395476 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c1ce5b0-915d-4367-b0b9-e2d1d5f28ed1 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:51.397726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c1ce5b0-915d-4367-b0b9-e2d1d5f28ed1 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:51.398988 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c1ce5b0-915d-4367-b0b9-e2d1d5f28ed1 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:51.792388 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f66e81b1-3d78-4e26-9090-d26ede77e44d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:51.816738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f66e81b1-3d78-4e26-9090-d26ede77e44d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.707529 Dec 16 14:38:51.817544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 79/155] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:51 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:51.854711 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:51.856042 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:51.884841 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:51.888863 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:51.890583 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:51.893925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:52.080010 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4c1ce5b0-915d-4367-b0b9-e2d1d5f28ed1 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:52.096382 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4c1ce5b0-915d-4367-b0b9-e2d1d5f28ed1 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1501 microversion: 2.1 time: 0.742488 Dec 16 14:38:52.097648 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 77/156] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:51 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1501 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:52.315512 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:52.332945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:52.341754 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:52.343705 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9edae930-e2a0-471b-9f7d-adf23d7698cb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.523812 Dec 16 14:38:52.344915 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 80/157] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:51 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:52.879537 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-47cbf54a-8c22-4ea0-a78c-223487e459d0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:52.881547 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-47cbf54a-8c22-4ea0-a78c-223487e459d0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:52.906704 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-47cbf54a-8c22-4ea0-a78c-223487e459d0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:52.907533 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-47cbf54a-8c22-4ea0-a78c-223487e459d0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:52.909621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-47cbf54a-8c22-4ea0-a78c-223487e459d0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:52.910836 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-47cbf54a-8c22-4ea0-a78c-223487e459d0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:53.335750 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-47cbf54a-8c22-4ea0-a78c-223487e459d0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:53.348923 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-47cbf54a-8c22-4ea0-a78c-223487e459d0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.509403 Dec 16 14:38:53.350238 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 78/158] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:52 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:53.378312 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:53.379353 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:53.390700 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:53.391162 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:53.392144 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:53.392677 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:53.868564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:53.886263 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:53.893395 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:53.894634 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9487b6e6-b5f8-4661-aa23-4b9d25e4f615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 0.536037 Dec 16 14:38:53.895373 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 81/159] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:53 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:54.384379 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2fd090f3-f02d-44a4-a3f1-d2547b76e729 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:54.386504 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2fd090f3-f02d-44a4-a3f1-d2547b76e729 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:54.396617 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2fd090f3-f02d-44a4-a3f1-d2547b76e729 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:54.397195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2fd090f3-f02d-44a4-a3f1-d2547b76e729 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:54.397886 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2fd090f3-f02d-44a4-a3f1-d2547b76e729 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:54.398452 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2fd090f3-f02d-44a4-a3f1-d2547b76e729 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:54.770038 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2fd090f3-f02d-44a4-a3f1-d2547b76e729 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:54.786014 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2fd090f3-f02d-44a4-a3f1-d2547b76e729 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.413392 Dec 16 14:38:54.788318 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 79/160] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:54 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:54.927089 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:54.928486 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:54.938520 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:54.939431 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:54.940580 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:54.941196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:55.881938 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-04b469a0-78c0-4552-a93b-5434b82b237f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:55.895713 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-04b469a0-78c0-4552-a93b-5434b82b237f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:55.908582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:55.916406 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04b469a0-78c0-4552-a93b-5434b82b237f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:55.917328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04b469a0-78c0-4552-a93b-5434b82b237f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:55.919337 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04b469a0-78c0-4552-a93b-5434b82b237f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:55.920134 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04b469a0-78c0-4552-a93b-5434b82b237f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:55.989274 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:56.012863 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:56.014053 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-da2915a8-4990-4edf-8a4d-e2e6bfb29dad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1407 microversion: 2.20 time: 1.099084 Dec 16 14:38:56.019259 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 82/161] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:54 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1407 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:38:56.161780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-9e588335-b582-4383-ab6a-fbc34a2117b7 req-135ce30c-6bd7-4521-bb71-d8702b83ec11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d728139-ef79-4b38-b489-6fd9aa84d0fa", "name": "network-vif-plugged", "status": "completed", "tag": "c97c5936-fff0-4630-886d-e693f3707c42"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:56.203108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:38:56.203108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:38:56.249277 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-9e588335-b582-4383-ab6a-fbc34a2117b7 req-135ce30c-6bd7-4521-bb71-d8702b83ec11 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:56.250044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-9e588335-b582-4383-ab6a-fbc34a2117b7 req-135ce30c-6bd7-4521-bb71-d8702b83ec11 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:56.330788 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-9e588335-b582-4383-ab6a-fbc34a2117b7 req-135ce30c-6bd7-4521-bb71-d8702b83ec11 service nova] Creating event network-vif-plugged:c97c5936-fff0-4630-886d-e693f3707c42 for instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa on hv-cinder-82189 Dec 16 14:38:56.350362 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-9e588335-b582-4383-ab6a-fbc34a2117b7 req-135ce30c-6bd7-4521-bb71-d8702b83ec11 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228249 Dec 16 14:38:56.352503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-04b469a0-78c0-4552-a93b-5434b82b237f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:56.352684 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 83/162] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:38:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:38:56.368835 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-04b469a0-78c0-4552-a93b-5434b82b237f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.558884 Dec 16 14:38:56.371248 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 80/163] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:55 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:56.694324 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3cd65045-96c1-4ad9-a806-d6db485423dc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af624fde-cb65-4e6f-94d7-43a6599e0a8b"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:38:56.696320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3cd65045-96c1-4ad9-a806-d6db485423dc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:56.726040 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3cd65045-96c1-4ad9-a806-d6db485423dc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:56.726837 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3cd65045-96c1-4ad9-a806-d6db485423dc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:56.728417 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3cd65045-96c1-4ad9-a806-d6db485423dc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:56.729177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3cd65045-96c1-4ad9-a806-d6db485423dc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:57.078474 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:57.079624 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:57.113154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:57.119232 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:57.121086 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:57.122964 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:57.672163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:57.703668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:57.719240 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:57.722268 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c549d7d5-3928-4b09-b162-a3203007facd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1599 microversion: 2.20 time: 0.675370 Dec 16 14:38:57.738280 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 81/164] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:38:57 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1599 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:57.750975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-16f69c5c-5bb9-47e8-a4b6-007b9d1cb824 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:57.751962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-16f69c5c-5bb9-47e8-a4b6-007b9d1cb824 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:57.760930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16f69c5c-5bb9-47e8-a4b6-007b9d1cb824 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:57.762030 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16f69c5c-5bb9-47e8-a4b6-007b9d1cb824 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:57.763278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16f69c5c-5bb9-47e8-a4b6-007b9d1cb824 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:57.763940 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16f69c5c-5bb9-47e8-a4b6-007b9d1cb824 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:58.306947 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3cd65045-96c1-4ad9-a806-d6db485423dc tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "POST /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.630698 Dec 16 14:38:58.311260 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 84/165] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:38:56 2021] POST /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030/os-volume_attachments => generated 194 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:38:58.354599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-16f69c5c-5bb9-47e8-a4b6-007b9d1cb824 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:38:58.360788 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c15ef425-be1a-461e-a01f-23e66949e612 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:58.364374 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c15ef425-be1a-461e-a01f-23e66949e612 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:58.382279 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c15ef425-be1a-461e-a01f-23e66949e612 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:58.383677 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c15ef425-be1a-461e-a01f-23e66949e612 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:58.386284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c15ef425-be1a-461e-a01f-23e66949e612 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:58.386978 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c15ef425-be1a-461e-a01f-23e66949e612 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:58.393938 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-16f69c5c-5bb9-47e8-a4b6-007b9d1cb824 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1363 microversion: 2.1 time: 0.653948 Dec 16 14:38:58.422578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 82/166] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:57 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1363 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:38:58.722299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c15ef425-be1a-461e-a01f-23e66949e612 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.406808 Dec 16 14:38:58.723772 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 85/167] 10.222.0.67 () {60 vars in 1315 bytes} [Thu Dec 16 14:38:58 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-interface => generated 284 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:38:59.449218 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f57079c4-25ad-4e40-92f0-1fdcc6bf6797 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:38:59.459931 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f57079c4-25ad-4e40-92f0-1fdcc6bf6797 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:38:59.497605 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f57079c4-25ad-4e40-92f0-1fdcc6bf6797 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:59.498349 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f57079c4-25ad-4e40-92f0-1fdcc6bf6797 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:59.499563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f57079c4-25ad-4e40-92f0-1fdcc6bf6797 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:59.500186 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f57079c4-25ad-4e40-92f0-1fdcc6bf6797 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:00.214783 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f57079c4-25ad-4e40-92f0-1fdcc6bf6797 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:39:00.237266 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f57079c4-25ad-4e40-92f0-1fdcc6bf6797 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1549 microversion: 2.1 time: 0.810580 Dec 16 14:39:00.238928 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 83/168] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:38:59 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1549 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:00.288861 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c03d2d2c-e5da-45ab-b871-d327d294bd8d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:00.290648 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c03d2d2c-e5da-45ab-b871-d327d294bd8d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:00.307689 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c03d2d2c-e5da-45ab-b871-d327d294bd8d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:00.308884 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c03d2d2c-e5da-45ab-b871-d327d294bd8d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:00.310612 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c03d2d2c-e5da-45ab-b871-d327d294bd8d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:00.311630 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c03d2d2c-e5da-45ab-b871-d327d294bd8d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:00.790957 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c03d2d2c-e5da-45ab-b871-d327d294bd8d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.534022 Dec 16 14:39:00.803815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 86/169] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Dec 16 14:39:00 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/os-interface => generated 284 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:02.813954 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-559f5681-9102-461b-8c3d-a28cfd0985d5 req-4890285e-738d-412b-b283-23a7bd9f44d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5b5c02-69ca-4290-bba0-54d6ed2eb215", "tag": "e59517d2-2291-4c73-889e-594d9cc076e2"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:02.835014 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5a27bad3-1876-4b92-8d6f-ddc97ef39c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:02.841528 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5a27bad3-1876-4b92-8d6f-ddc97ef39c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:02.851207 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:02.851207 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:39:02.872325 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a27bad3-1876-4b92-8d6f-ddc97ef39c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:02.872878 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a27bad3-1876-4b92-8d6f-ddc97ef39c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:02.873925 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a27bad3-1876-4b92-8d6f-ddc97ef39c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:02.879546 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a27bad3-1876-4b92-8d6f-ddc97ef39c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:02.890969 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-559f5681-9102-461b-8c3d-a28cfd0985d5 req-4890285e-738d-412b-b283-23a7bd9f44d3 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:02.892372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-559f5681-9102-461b-8c3d-a28cfd0985d5 req-4890285e-738d-412b-b283-23a7bd9f44d3 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:02.928463 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-559f5681-9102-461b-8c3d-a28cfd0985d5 req-4890285e-738d-412b-b283-23a7bd9f44d3 service nova] Creating event network-changed:e59517d2-2291-4c73-889e-594d9cc076e2 for instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 on hv-cinder-82189 Dec 16 14:39:02.950454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-559f5681-9102-461b-8c3d-a28cfd0985d5 req-4890285e-738d-412b-b283-23a7bd9f44d3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144460 Dec 16 14:39:02.956263 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 87/170] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:39:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:39:03.664722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5a27bad3-1876-4b92-8d6f-ddc97ef39c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 14 microversion: 2.20 time: 0.876360 Dec 16 14:39:03.666375 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 84/171] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:02 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 14 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:39:04.688202 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e0b4e30d-b7ee-4085-8b45-23df1d58d128 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:04.699259 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e0b4e30d-b7ee-4085-8b45-23df1d58d128 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:04.723073 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e0b4e30d-b7ee-4085-8b45-23df1d58d128 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:04.723733 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e0b4e30d-b7ee-4085-8b45-23df1d58d128 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:04.724874 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e0b4e30d-b7ee-4085-8b45-23df1d58d128 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:04.725218 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e0b4e30d-b7ee-4085-8b45-23df1d58d128 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:04.962751 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e0b4e30d-b7ee-4085-8b45-23df1d58d128 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 14 microversion: 2.20 time: 0.289619 Dec 16 14:39:04.966233 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 88/172] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:04 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 14 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:05.560149 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bc3403b3-bfc5-49a2-a088-970043ffa521 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:05.563637 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-bc3403b3-bfc5-49a2-a088-970043ffa521 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:05.580293 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bc3403b3-bfc5-49a2-a088-970043ffa521 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:05.581616 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bc3403b3-bfc5-49a2-a088-970043ffa521 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:05.583793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bc3403b3-bfc5-49a2-a088-970043ffa521 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:05.584843 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bc3403b3-bfc5-49a2-a088-970043ffa521 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:05.623828 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-cf1bbb3d-d100-4d0b-97c6-974a6c7fbd81 req-be2a93ee-a8d8-4858-b096-e58feae8907c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d728139-ef79-4b38-b489-6fd9aa84d0fa", "tag": "c97c5936-fff0-4630-886d-e693f3707c42"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:05.644826 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:05.644826 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:39:05.673716 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-cf1bbb3d-d100-4d0b-97c6-974a6c7fbd81 req-be2a93ee-a8d8-4858-b096-e58feae8907c service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:05.674888 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-cf1bbb3d-d100-4d0b-97c6-974a6c7fbd81 req-be2a93ee-a8d8-4858-b096-e58feae8907c service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:05.734135 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-cf1bbb3d-d100-4d0b-97c6-974a6c7fbd81 req-be2a93ee-a8d8-4858-b096-e58feae8907c service nova] Creating event network-changed:c97c5936-fff0-4630-886d-e693f3707c42 for instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa on hv-cinder-82189 Dec 16 14:39:05.761035 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-cf1bbb3d-d100-4d0b-97c6-974a6c7fbd81 req-be2a93ee-a8d8-4858-b096-e58feae8907c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193278 Dec 16 14:39:05.769336 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 89/173] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:39:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:05.966995 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-bc3403b3-bfc5-49a2-a088-970043ffa521 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 14 microversion: 2.1 time: 0.420728 Dec 16 14:39:05.981775 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 85/174] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:05 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 14 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:39:06.013140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-dbc74f2e-e3e2-4c17-bef9-a0368c293cfe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:06.017804 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-dbc74f2e-e3e2-4c17-bef9-a0368c293cfe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:06.046488 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dbc74f2e-e3e2-4c17-bef9-a0368c293cfe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:06.048295 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dbc74f2e-e3e2-4c17-bef9-a0368c293cfe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:06.051964 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dbc74f2e-e3e2-4c17-bef9-a0368c293cfe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:06.052762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dbc74f2e-e3e2-4c17-bef9-a0368c293cfe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:06.526447 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-dbc74f2e-e3e2-4c17-bef9-a0368c293cfe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 14 microversion: 2.20 time: 0.551905 Dec 16 14:39:06.529433 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 90/175] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:05 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 14 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:39:07.031737 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-559d40b1-4abb-4047-9a61-40936aca3a2f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:07.034704 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-559d40b1-4abb-4047-9a61-40936aca3a2f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:07.071861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-559d40b1-4abb-4047-9a61-40936aca3a2f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:07.073158 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-559d40b1-4abb-4047-9a61-40936aca3a2f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:07.083122 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-559d40b1-4abb-4047-9a61-40936aca3a2f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:07.084447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-559d40b1-4abb-4047-9a61-40936aca3a2f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:07.584234 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a04b1e05-c20f-43f5-afad-a54fd23da7a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:07.592707 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a04b1e05-c20f-43f5-afad-a54fd23da7a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:07.630222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a04b1e05-c20f-43f5-afad-a54fd23da7a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:07.630222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a04b1e05-c20f-43f5-afad-a54fd23da7a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:07.637800 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a04b1e05-c20f-43f5-afad-a54fd23da7a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:07.638611 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a04b1e05-c20f-43f5-afad-a54fd23da7a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:07.708019 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-559d40b1-4abb-4047-9a61-40936aca3a2f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 14 microversion: 2.1 time: 0.729442 Dec 16 14:39:07.709839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 86/176] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:06 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 14 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:39:08.747756 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-52149e54-6735-4787-9efc-356bd29fdf39 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:08.750879 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-52149e54-6735-4787-9efc-356bd29fdf39 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:08.767179 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-52149e54-6735-4787-9efc-356bd29fdf39 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:08.768136 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-52149e54-6735-4787-9efc-356bd29fdf39 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:08.769457 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-52149e54-6735-4787-9efc-356bd29fdf39 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:08.770637 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-52149e54-6735-4787-9efc-356bd29fdf39 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:11.807622 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a04b1e05-c20f-43f5-afad-a54fd23da7a4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 11283 microversion: 2.20 time: 4.268137 Dec 16 14:39:11.809493 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 91/177] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:07 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 11283 bytes in 4272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:11.862029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-52149e54-6735-4787-9efc-356bd29fdf39 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 14 microversion: 2.1 time: 3.141474 Dec 16 14:39:11.865105 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 87/178] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:08 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 14 bytes in 3147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:39:12.836001 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a37b29e6-fc1c-408e-907f-cba0bf72973c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:12.837514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a37b29e6-fc1c-408e-907f-cba0bf72973c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:12.852557 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a37b29e6-fc1c-408e-907f-cba0bf72973c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:12.853694 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a37b29e6-fc1c-408e-907f-cba0bf72973c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:12.854685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a37b29e6-fc1c-408e-907f-cba0bf72973c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:12.855783 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a37b29e6-fc1c-408e-907f-cba0bf72973c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:12.885578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-83a4f417-8a66-4693-8a0b-4ca2397d454e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:12.887751 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-83a4f417-8a66-4693-8a0b-4ca2397d454e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:12.917299 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83a4f417-8a66-4693-8a0b-4ca2397d454e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:12.918128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83a4f417-8a66-4693-8a0b-4ca2397d454e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:12.919644 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83a4f417-8a66-4693-8a0b-4ca2397d454e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:12.920397 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83a4f417-8a66-4693-8a0b-4ca2397d454e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:13.141139 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a37b29e6-fc1c-408e-907f-cba0bf72973c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 15895 microversion: 2.20 time: 0.322755 Dec 16 14:39:13.146030 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 92/179] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:12 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 15895 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:13.206107 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-83a4f417-8a66-4693-8a0b-4ca2397d454e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 14 microversion: 2.1 time: 0.333434 Dec 16 14:39:13.212713 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 88/180] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:12 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 14 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:39:14.179365 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-30503e49-241d-40fa-b750-ee1b7e4ca567 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:14.182350 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-30503e49-241d-40fa-b750-ee1b7e4ca567 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:14.205111 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30503e49-241d-40fa-b750-ee1b7e4ca567 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:14.212997 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30503e49-241d-40fa-b750-ee1b7e4ca567 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:14.217000 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30503e49-241d-40fa-b750-ee1b7e4ca567 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:14.217000 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30503e49-241d-40fa-b750-ee1b7e4ca567 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:14.248624 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c77359e6-e2fd-4899-9f52-86402e1c6847 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:14.251032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c77359e6-e2fd-4899-9f52-86402e1c6847 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:14.282179 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c77359e6-e2fd-4899-9f52-86402e1c6847 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:14.289442 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c77359e6-e2fd-4899-9f52-86402e1c6847 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:14.291561 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c77359e6-e2fd-4899-9f52-86402e1c6847 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:14.294413 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c77359e6-e2fd-4899-9f52-86402e1c6847 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:18.216514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-30503e49-241d-40fa-b750-ee1b7e4ca567 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 23955 microversion: 2.20 time: 4.064110 Dec 16 14:39:18.218859 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 93/181] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:14 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 23955 bytes in 4069 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:18.235255 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c77359e6-e2fd-4899-9f52-86402e1c6847 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 19342 microversion: 2.1 time: 4.016143 Dec 16 14:39:18.239464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 89/182] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:14 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 19342 bytes in 4022 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:19.254954 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cc31e897-e767-400b-af5e-7176d2408d03 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:19.257936 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cc31e897-e767-400b-af5e-7176d2408d03 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:19.270065 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc31e897-e767-400b-af5e-7176d2408d03 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:19.270987 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc31e897-e767-400b-af5e-7176d2408d03 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:19.271560 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-dc0388b7-e7a6-4e3d-99bd-4d799612707c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:19.273175 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc31e897-e767-400b-af5e-7176d2408d03 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:19.274153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc31e897-e767-400b-af5e-7176d2408d03 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:19.286592 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-dc0388b7-e7a6-4e3d-99bd-4d799612707c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:19.320071 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dc0388b7-e7a6-4e3d-99bd-4d799612707c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:19.321336 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dc0388b7-e7a6-4e3d-99bd-4d799612707c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:19.323430 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dc0388b7-e7a6-4e3d-99bd-4d799612707c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:19.324454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dc0388b7-e7a6-4e3d-99bd-4d799612707c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:23.082309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-dc0388b7-e7a6-4e3d-99bd-4d799612707c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 27575 microversion: 2.20 time: 3.850506 Dec 16 14:39:23.083773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 94/183] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:19 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 27575 bytes in 3855 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:23.106842 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e14993c4-3bb0-4cb1-ae90-390c8f7b9cfd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:23.107710 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e14993c4-3bb0-4cb1-ae90-390c8f7b9cfd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:23.123755 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e14993c4-3bb0-4cb1-ae90-390c8f7b9cfd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:23.124528 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e14993c4-3bb0-4cb1-ae90-390c8f7b9cfd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:23.125912 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e14993c4-3bb0-4cb1-ae90-390c8f7b9cfd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:23.126710 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e14993c4-3bb0-4cb1-ae90-390c8f7b9cfd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:23.160719 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cc31e897-e767-400b-af5e-7176d2408d03 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 26303 microversion: 2.1 time: 3.916629 Dec 16 14:39:23.162593 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 90/184] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:19 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 26303 bytes in 3920 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:39:23.227002 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e14993c4-3bb0-4cb1-ae90-390c8f7b9cfd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:39:23.391628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e14993c4-3bb0-4cb1-ae90-390c8f7b9cfd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 204 len: 0 microversion: 2.1 time: 0.304133 Dec 16 14:39:23.392456 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 95/185] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:39:23 2021] DELETE /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:39:23.409472 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-588ed89c-3204-41bd-93cc-b9b229def7fe tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:23.410297 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-588ed89c-3204-41bd-93cc-b9b229def7fe tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:23.420213 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-588ed89c-3204-41bd-93cc-b9b229def7fe tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:23.420692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-588ed89c-3204-41bd-93cc-b9b229def7fe tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:23.421625 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-588ed89c-3204-41bd-93cc-b9b229def7fe tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:23.422193 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-588ed89c-3204-41bd-93cc-b9b229def7fe tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:23.772898 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-588ed89c-3204-41bd-93cc-b9b229def7fe tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:39:23.784464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-588ed89c-3204-41bd-93cc-b9b229def7fe tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1553 microversion: 2.1 time: 0.386498 Dec 16 14:39:23.785396 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 91/186] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:23 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1553 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:39:24.104437 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-693bc7fe-3713-4e46-a100-9ed95306e117 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:24.105588 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-693bc7fe-3713-4e46-a100-9ed95306e117 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:24.115274 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-693bc7fe-3713-4e46-a100-9ed95306e117 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:24.115945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-693bc7fe-3713-4e46-a100-9ed95306e117 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:24.116962 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-693bc7fe-3713-4e46-a100-9ed95306e117 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:24.117512 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-693bc7fe-3713-4e46-a100-9ed95306e117 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:24.190266 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-746d3a43-e6e6-4847-8b0b-84b52f344340 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:24.191777 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-746d3a43-e6e6-4847-8b0b-84b52f344340 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:24.206595 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-746d3a43-e6e6-4847-8b0b-84b52f344340 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:24.207383 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-746d3a43-e6e6-4847-8b0b-84b52f344340 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:24.208720 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-746d3a43-e6e6-4847-8b0b-84b52f344340 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:24.209421 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-746d3a43-e6e6-4847-8b0b-84b52f344340 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:24.335438 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-693bc7fe-3713-4e46-a100-9ed95306e117 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 27770 microversion: 2.20 time: 0.242146 Dec 16 14:39:24.336353 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 96/187] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:24 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 27770 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:24.452252 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-746d3a43-e6e6-4847-8b0b-84b52f344340 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 27304 microversion: 2.1 time: 0.280074 Dec 16 14:39:24.452951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 92/188] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:24 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 27304 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:39:24.818123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-abdae2ff-0187-42be-ab8a-afac6a76cb53 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:24.818945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-abdae2ff-0187-42be-ab8a-afac6a76cb53 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:24.828593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-abdae2ff-0187-42be-ab8a-afac6a76cb53 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:24.829096 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-abdae2ff-0187-42be-ab8a-afac6a76cb53 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:24.829950 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-abdae2ff-0187-42be-ab8a-afac6a76cb53 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:24.830481 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-abdae2ff-0187-42be-ab8a-afac6a76cb53 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:25.206286 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-abdae2ff-0187-42be-ab8a-afac6a76cb53 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:39:25.225335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-abdae2ff-0187-42be-ab8a-afac6a76cb53 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1553 microversion: 2.1 time: 0.417624 Dec 16 14:39:25.227536 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 97/189] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:24 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1553 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:25.372403 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-27cea16d-7b0f-49ac-a0e3-b7d86e97ee2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:25.374359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-27cea16d-7b0f-49ac-a0e3-b7d86e97ee2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:25.391381 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27cea16d-7b0f-49ac-a0e3-b7d86e97ee2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:25.392563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27cea16d-7b0f-49ac-a0e3-b7d86e97ee2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:25.394363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27cea16d-7b0f-49ac-a0e3-b7d86e97ee2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:25.395513 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27cea16d-7b0f-49ac-a0e3-b7d86e97ee2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:25.475637 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6647182b-5fc0-4120-87bf-b2f4411c2bc2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:25.477055 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6647182b-5fc0-4120-87bf-b2f4411c2bc2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:25.487903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6647182b-5fc0-4120-87bf-b2f4411c2bc2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:25.488339 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6647182b-5fc0-4120-87bf-b2f4411c2bc2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:25.489163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6647182b-5fc0-4120-87bf-b2f4411c2bc2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:25.489598 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6647182b-5fc0-4120-87bf-b2f4411c2bc2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:25.640898 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-27cea16d-7b0f-49ac-a0e3-b7d86e97ee2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 27772 microversion: 2.20 time: 0.291465 Dec 16 14:39:25.643422 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 93/190] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:25 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 27772 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:25.706497 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6647182b-5fc0-4120-87bf-b2f4411c2bc2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 27724 microversion: 2.1 time: 0.243863 Dec 16 14:39:25.707166 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 98/191] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:25 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 27724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:39:26.263666 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-084a0c64-78f0-4ade-be81-873f15d2f128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:26.264963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-084a0c64-78f0-4ade-be81-873f15d2f128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:26.279588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-084a0c64-78f0-4ade-be81-873f15d2f128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:26.280693 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-084a0c64-78f0-4ade-be81-873f15d2f128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:26.282366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-084a0c64-78f0-4ade-be81-873f15d2f128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:26.283373 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-084a0c64-78f0-4ade-be81-873f15d2f128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:26.667808 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-df33b559-6deb-4079-afae-1120bac9e70f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:26.670172 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-df33b559-6deb-4079-afae-1120bac9e70f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:26.681932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-df33b559-6deb-4079-afae-1120bac9e70f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:26.682413 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-df33b559-6deb-4079-afae-1120bac9e70f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:26.683349 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-df33b559-6deb-4079-afae-1120bac9e70f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:26.683814 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-df33b559-6deb-4079-afae-1120bac9e70f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:26.703086 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-084a0c64-78f0-4ade-be81-873f15d2f128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:39:26.737614 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-084a0c64-78f0-4ade-be81-873f15d2f128 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1553 microversion: 2.1 time: 0.484096 Dec 16 14:39:26.739053 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 94/192] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:26 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1553 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:26.767610 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-95fcaa55-4c80-41cc-94bc-f9668a9dd861 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:26.769083 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-95fcaa55-4c80-41cc-94bc-f9668a9dd861 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:26.793825 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-95fcaa55-4c80-41cc-94bc-f9668a9dd861 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:26.795512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-95fcaa55-4c80-41cc-94bc-f9668a9dd861 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:26.796785 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-95fcaa55-4c80-41cc-94bc-f9668a9dd861 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:26.797754 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-95fcaa55-4c80-41cc-94bc-f9668a9dd861 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:26.928256 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-df33b559-6deb-4079-afae-1120bac9e70f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 27837 microversion: 2.20 time: 0.274585 Dec 16 14:39:26.929020 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 99/193] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:26 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 27837 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:39:27.013350 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-95fcaa55-4c80-41cc-94bc-f9668a9dd861 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28017 microversion: 2.1 time: 0.272055 Dec 16 14:39:27.013944 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 95/194] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:26 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28017 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:27.784045 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c2df886b-b4e3-4482-be74-0a2bb3445688 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:27.785579 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c2df886b-b4e3-4482-be74-0a2bb3445688 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:27.814710 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c2df886b-b4e3-4482-be74-0a2bb3445688 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:27.815665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c2df886b-b4e3-4482-be74-0a2bb3445688 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:27.817352 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c2df886b-b4e3-4482-be74-0a2bb3445688 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:27.818752 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c2df886b-b4e3-4482-be74-0a2bb3445688 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:27.962592 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-20558df9-4df1-422a-bbcf-96252b249bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:27.964494 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-20558df9-4df1-422a-bbcf-96252b249bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:27.984491 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20558df9-4df1-422a-bbcf-96252b249bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:27.985320 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20558df9-4df1-422a-bbcf-96252b249bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:27.986821 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20558df9-4df1-422a-bbcf-96252b249bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:27.987773 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20558df9-4df1-422a-bbcf-96252b249bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:28.318139 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-20558df9-4df1-422a-bbcf-96252b249bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.378224 Dec 16 14:39:28.319630 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 96/195] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:27 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:28.383426 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c2df886b-b4e3-4482-be74-0a2bb3445688 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:39:28.386479 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-90f9051e-a6b0-4f0a-aa3e-584ce9b71706 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:28.389424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-90f9051e-a6b0-4f0a-aa3e-584ce9b71706 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:28.422933 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c2df886b-b4e3-4482-be74-0a2bb3445688 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1553 microversion: 2.1 time: 0.656652 Dec 16 14:39:28.424237 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 100/196] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:27 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1553 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:28.445451 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-90f9051e-a6b0-4f0a-aa3e-584ce9b71706 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:28.447512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-90f9051e-a6b0-4f0a-aa3e-584ce9b71706 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:28.449844 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-90f9051e-a6b0-4f0a-aa3e-584ce9b71706 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:28.450840 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-90f9051e-a6b0-4f0a-aa3e-584ce9b71706 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:28.686783 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-90f9051e-a6b0-4f0a-aa3e-584ce9b71706 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.361914 Dec 16 14:39:28.688085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 97/197] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:28 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:28.958108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-55f09275-b63d-4a6e-951c-958b82494e1c req-62345940-a20c-402c-a66d-bd060dd5eb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4cf5bc-8f2b-4e78-93cd-a3097aa16030", "name": "network-vif-deleted", "tag": "4288c836-920e-4dde-9566-78d211f0412e"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:28.977922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:28.977922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:39:29.000180 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-55f09275-b63d-4a6e-951c-958b82494e1c req-62345940-a20c-402c-a66d-bd060dd5eb0a service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:29.001124 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-55f09275-b63d-4a6e-951c-958b82494e1c req-62345940-a20c-402c-a66d-bd060dd5eb0a service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:29.042521 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-55f09275-b63d-4a6e-951c-958b82494e1c req-62345940-a20c-402c-a66d-bd060dd5eb0a service nova] Creating event network-vif-deleted:4288c836-920e-4dde-9566-78d211f0412e for instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 on hv-cinder-82189 Dec 16 14:39:29.053277 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-55f09275-b63d-4a6e-951c-958b82494e1c req-62345940-a20c-402c-a66d-bd060dd5eb0a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123876 Dec 16 14:39:29.054643 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 101/198] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:39:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:29.351197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3ce01721-c72e-4098-a8a3-053a6d22b0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:29.353077 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3ce01721-c72e-4098-a8a3-053a6d22b0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:29.364625 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3ce01721-c72e-4098-a8a3-053a6d22b0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:29.365768 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3ce01721-c72e-4098-a8a3-053a6d22b0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:29.367142 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3ce01721-c72e-4098-a8a3-053a6d22b0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:29.367965 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3ce01721-c72e-4098-a8a3-053a6d22b0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:29.472461 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d6b6da6b-226b-450f-8b14-e476c526cd8d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:29.473742 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d6b6da6b-226b-450f-8b14-e476c526cd8d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:29.488485 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d6b6da6b-226b-450f-8b14-e476c526cd8d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:29.489289 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d6b6da6b-226b-450f-8b14-e476c526cd8d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:29.490730 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d6b6da6b-226b-450f-8b14-e476c526cd8d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:29.491466 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d6b6da6b-226b-450f-8b14-e476c526cd8d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:29.526800 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3ce01721-c72e-4098-a8a3-053a6d22b0d5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.194707 Dec 16 14:39:29.530364 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 98/199] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:29 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:29.730953 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-55325951-892e-41de-a345-a385ff2f1341 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:29.733100 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-55325951-892e-41de-a345-a385ff2f1341 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:29.745229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-55325951-892e-41de-a345-a385ff2f1341 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:29.745480 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d6b6da6b-226b-450f-8b14-e476c526cd8d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:39:29.745787 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-55325951-892e-41de-a345-a385ff2f1341 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:29.747559 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-55325951-892e-41de-a345-a385ff2f1341 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:29.748066 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-55325951-892e-41de-a345-a385ff2f1341 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:29.767329 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d6b6da6b-226b-450f-8b14-e476c526cd8d tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1345 microversion: 2.1 time: 0.315420 Dec 16 14:39:29.768593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 102/200] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:29 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1345 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:29.929817 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-55325951-892e-41de-a345-a385ff2f1341 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.227994 Dec 16 14:39:29.935145 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 99/201] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:29 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:30.557780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-334ea14a-3e25-4de4-9eec-b0d09d327c29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:30.558815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-334ea14a-3e25-4de4-9eec-b0d09d327c29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:30.566996 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-334ea14a-3e25-4de4-9eec-b0d09d327c29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:30.567728 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-334ea14a-3e25-4de4-9eec-b0d09d327c29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:30.568785 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-334ea14a-3e25-4de4-9eec-b0d09d327c29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:30.569214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-334ea14a-3e25-4de4-9eec-b0d09d327c29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:30.817463 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:30.819843 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:30.830262 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:30.830738 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:30.831981 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:30.832797 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:30.946877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:30.946877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:30.946877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lazy-loading 'fault' on Instance uuid ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:39:31.086036 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-334ea14a-3e25-4de4-9eec-b0d09d327c29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.543359 Dec 16 14:39:31.089230 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 103/202] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:30 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:31.098662 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '108e1d33249b49dcb6e3779514bc7a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:39:31.118054 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-71311707-f75a-4844-a986-ae942a785508 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:31.120936 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-71311707-f75a-4844-a986-ae942a785508 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:31.121254 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-76d3beab-b2c4-46bd-95e4-f3b2efee6c5f tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 200 len: 1304 microversion: 2.1 time: 0.329994 Dec 16 14:39:31.135170 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 100/203] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:30 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 1304 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:31.143576 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-71311707-f75a-4844-a986-ae942a785508 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:31.145658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-71311707-f75a-4844-a986-ae942a785508 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:31.148143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-71311707-f75a-4844-a986-ae942a785508 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:31.148998 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-71311707-f75a-4844-a986-ae942a785508 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:32.123428 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c3a6242a-2ab4-4cec-b6e9-2303b95ad806 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:32.125173 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c3a6242a-2ab4-4cec-b6e9-2303b95ad806 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:32.140792 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c3a6242a-2ab4-4cec-b6e9-2303b95ad806 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:32.141441 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c3a6242a-2ab4-4cec-b6e9-2303b95ad806 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:32.142494 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c3a6242a-2ab4-4cec-b6e9-2303b95ad806 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:32.143043 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c3a6242a-2ab4-4cec-b6e9-2303b95ad806 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:34.737796 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-71311707-f75a-4844-a986-ae942a785508 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 3.645486 Dec 16 14:39:34.739318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 104/204] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:31 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 3649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:34.755774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b18f7163-ad36-4aea-b201-8a41e4feeffd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:34.756893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b18f7163-ad36-4aea-b201-8a41e4feeffd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:34.757451 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c3a6242a-2ab4-4cec-b6e9-2303b95ad806 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 2.659645 Dec 16 14:39:34.758890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 101/205] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:32 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 2663 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:39:34.770589 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b18f7163-ad36-4aea-b201-8a41e4feeffd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:34.771515 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b18f7163-ad36-4aea-b201-8a41e4feeffd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:34.772585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b18f7163-ad36-4aea-b201-8a41e4feeffd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:34.773214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b18f7163-ad36-4aea-b201-8a41e4feeffd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:34.850658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-b18f7163-ad36-4aea-b201-8a41e4feeffd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] HTTP exception thrown: Instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 could not be found. Dec 16 14:39:34.855750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b18f7163-ad36-4aea-b201-8a41e4feeffd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Returning 404 to user: Instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:39:34.855750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b18f7163-ad36-4aea-b201-8a41e4feeffd tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 404 len: 111 microversion: 2.1 time: 0.111923 Dec 16 14:39:34.855750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 105/206] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:34 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:39:35.200284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4cd55ec3-7ca5-4c26-9b0e-6f375c169409 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:35.202416 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4cd55ec3-7ca5-4c26-9b0e-6f375c169409 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:35.219378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4cd55ec3-7ca5-4c26-9b0e-6f375c169409 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:35.219995 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4cd55ec3-7ca5-4c26-9b0e-6f375c169409 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:35.221982 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4cd55ec3-7ca5-4c26-9b0e-6f375c169409 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:35.222600 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4cd55ec3-7ca5-4c26-9b0e-6f375c169409 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:35.324630 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-4cd55ec3-7ca5-4c26-9b0e-6f375c169409 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] HTTP exception thrown: Instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 could not be found. Dec 16 14:39:35.325760 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4cd55ec3-7ca5-4c26-9b0e-6f375c169409 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Returning 404 to user: Instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:39:35.327241 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4cd55ec3-7ca5-4c26-9b0e-6f375c169409 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.148186 Dec 16 14:39:35.328174 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 102/207] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:39:35 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030/os-volume_attachments => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:39:35.762992 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8a7085a0-ac03-440a-aad7-6811633ae0ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:35.763880 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8a7085a0-ac03-440a-aad7-6811633ae0ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:35.781137 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8a7085a0-ac03-440a-aad7-6811633ae0ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:35.781710 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8a7085a0-ac03-440a-aad7-6811633ae0ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:35.783796 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8a7085a0-ac03-440a-aad7-6811633ae0ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:35.784747 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8a7085a0-ac03-440a-aad7-6811633ae0ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:35.797891 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d00fdc5e-1a9c-4a3b-a660-1e88ad81487f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:35.803626 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d00fdc5e-1a9c-4a3b-a660-1e88ad81487f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:35.819936 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d00fdc5e-1a9c-4a3b-a660-1e88ad81487f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:35.820848 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d00fdc5e-1a9c-4a3b-a660-1e88ad81487f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:35.823290 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d00fdc5e-1a9c-4a3b-a660-1e88ad81487f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:35.824509 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d00fdc5e-1a9c-4a3b-a660-1e88ad81487f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:36.050111 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8a7085a0-ac03-440a-aad7-6811633ae0ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.301912 Dec 16 14:39:36.051270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 106/208] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:35 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:36.076650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d00fdc5e-1a9c-4a3b-a660-1e88ad81487f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.304291 Dec 16 14:39:36.077742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 103/209] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:35 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:37.103877 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6e856f3f-b1eb-4e82-880e-cbf38ae388bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:37.108175 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6e856f3f-b1eb-4e82-880e-cbf38ae388bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:37.127525 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6e856f3f-b1eb-4e82-880e-cbf38ae388bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:37.129629 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6e856f3f-b1eb-4e82-880e-cbf38ae388bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:37.132340 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6e856f3f-b1eb-4e82-880e-cbf38ae388bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:37.133462 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6e856f3f-b1eb-4e82-880e-cbf38ae388bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:37.150773 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-44ed0129-22c6-4169-9aee-93cd05c62793 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:37.151876 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-44ed0129-22c6-4169-9aee-93cd05c62793 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:37.171805 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44ed0129-22c6-4169-9aee-93cd05c62793 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:37.172243 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44ed0129-22c6-4169-9aee-93cd05c62793 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:37.177512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44ed0129-22c6-4169-9aee-93cd05c62793 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:37.178113 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44ed0129-22c6-4169-9aee-93cd05c62793 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:37.414420 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6e856f3f-b1eb-4e82-880e-cbf38ae388bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.349798 Dec 16 14:39:37.416086 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 107/210] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:37 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:37.437674 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-44ed0129-22c6-4169-9aee-93cd05c62793 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.346461 Dec 16 14:39:37.439965 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 104/211] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:37 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:39:37.446051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fa9245a2-1f5e-4d9c-bd78-dc1ada1642ac tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:37.446051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fa9245a2-1f5e-4d9c-bd78-dc1ada1642ac tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:37.461857 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa9245a2-1f5e-4d9c-bd78-dc1ada1642ac tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:37.462810 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa9245a2-1f5e-4d9c-bd78-dc1ada1642ac tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:37.464326 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa9245a2-1f5e-4d9c-bd78-dc1ada1642ac tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:37.465252 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa9245a2-1f5e-4d9c-bd78-dc1ada1642ac tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:37.603351 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-fa9245a2-1f5e-4d9c-bd78-dc1ada1642ac tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] HTTP exception thrown: Instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 could not be found. Dec 16 14:39:37.604078 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fa9245a2-1f5e-4d9c-bd78-dc1ada1642ac tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Returning 404 to user: Instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:39:37.606570 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fa9245a2-1f5e-4d9c-bd78-dc1ada1642ac tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 404 len: 111 microversion: 2.1 time: 0.188444 Dec 16 14:39:37.607440 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 108/212] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:39:37 2021] DELETE /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:39:37.641232 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-65677e3b-b835-4f6e-8965-b79fbf7cfa68 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:37.642822 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-65677e3b-b835-4f6e-8965-b79fbf7cfa68 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] [instance: ea4cf5bc-8f2b-4e78-93cd-a3097aa16030] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:37.660983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65677e3b-b835-4f6e-8965-b79fbf7cfa68 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:37.661762 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65677e3b-b835-4f6e-8965-b79fbf7cfa68 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:37.663481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65677e3b-b835-4f6e-8965-b79fbf7cfa68 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:37.664277 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65677e3b-b835-4f6e-8965-b79fbf7cfa68 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:37.797092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-65677e3b-b835-4f6e-8965-b79fbf7cfa68 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] HTTP exception thrown: Instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 could not be found. Dec 16 14:39:37.797092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-65677e3b-b835-4f6e-8965-b79fbf7cfa68 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] Returning 404 to user: Instance ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:39:37.797092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-65677e3b-b835-4f6e-8965-b79fbf7cfa68 tempest-DeleteServersTestJSON-392369734 tempest-DeleteServersTestJSON-392369734-project] 10.222.0.67 "GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030" status: 404 len: 111 microversion: 2.1 time: 0.182632 Dec 16 14:39:37.797492 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 105/213] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:37 2021] GET /compute/v2.1/servers/ea4cf5bc-8f2b-4e78-93cd-a3097aa16030 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:39:38.452065 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b9b2818a-8f61-4edb-a25b-f8ad38f502e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:38.455835 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b9b2818a-8f61-4edb-a25b-f8ad38f502e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:38.520407 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-34a081c8-c3c0-4d65-b105-e45889af1635 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:38.524195 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b9b2818a-8f61-4edb-a25b-f8ad38f502e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:38.534342 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-34a081c8-c3c0-4d65-b105-e45889af1635 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:38.547249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b9b2818a-8f61-4edb-a25b-f8ad38f502e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:38.548229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34a081c8-c3c0-4d65-b105-e45889af1635 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:38.549167 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b9b2818a-8f61-4edb-a25b-f8ad38f502e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:38.549941 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b9b2818a-8f61-4edb-a25b-f8ad38f502e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:38.550127 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34a081c8-c3c0-4d65-b105-e45889af1635 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:38.551736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34a081c8-c3c0-4d65-b105-e45889af1635 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:38.552768 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34a081c8-c3c0-4d65-b105-e45889af1635 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:38.773315 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-34a081c8-c3c0-4d65-b105-e45889af1635 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.320544 Dec 16 14:39:38.782537 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 106/214] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:38 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:38.884588 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b9b2818a-8f61-4edb-a25b-f8ad38f502e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.456988 Dec 16 14:39:38.886394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 109/215] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:38 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:39.821855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-04c085e3-b985-46da-b674-c274fa8b34b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:39.827241 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-04c085e3-b985-46da-b674-c274fa8b34b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:39.857419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04c085e3-b985-46da-b674-c274fa8b34b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:39.858486 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04c085e3-b985-46da-b674-c274fa8b34b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:39.860523 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04c085e3-b985-46da-b674-c274fa8b34b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:39.861314 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04c085e3-b985-46da-b674-c274fa8b34b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:39.968927 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-88887939-43f2-4695-a225-551cd90b9c89 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:39.974542 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-88887939-43f2-4695-a225-551cd90b9c89 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:39.992974 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-88887939-43f2-4695-a225-551cd90b9c89 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:39.993893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-88887939-43f2-4695-a225-551cd90b9c89 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:39.995411 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-88887939-43f2-4695-a225-551cd90b9c89 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:39.996210 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-88887939-43f2-4695-a225-551cd90b9c89 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:40.051874 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-04c085e3-b985-46da-b674-c274fa8b34b1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.264291 Dec 16 14:39:40.057686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 107/216] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:39 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:39:40.260522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-88887939-43f2-4695-a225-551cd90b9c89 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.355458 Dec 16 14:39:40.268337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 110/217] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:39 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:41.085514 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-324afc91-833a-4c37-a384-880bc7b29f8a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:41.092348 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-324afc91-833a-4c37-a384-880bc7b29f8a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:41.132498 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-324afc91-833a-4c37-a384-880bc7b29f8a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:41.134187 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-324afc91-833a-4c37-a384-880bc7b29f8a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:41.140092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-324afc91-833a-4c37-a384-880bc7b29f8a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:41.143235 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-324afc91-833a-4c37-a384-880bc7b29f8a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:41.324033 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0950939f-4caa-4aa4-a8da-deb10e79a708 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:41.335273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0950939f-4caa-4aa4-a8da-deb10e79a708 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:41.390506 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0950939f-4caa-4aa4-a8da-deb10e79a708 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:41.393361 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0950939f-4caa-4aa4-a8da-deb10e79a708 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:41.403027 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0950939f-4caa-4aa4-a8da-deb10e79a708 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:41.403956 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0950939f-4caa-4aa4-a8da-deb10e79a708 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:41.626209 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0950939f-4caa-4aa4-a8da-deb10e79a708 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.351308 Dec 16 14:39:41.633186 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 111/218] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:41 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:39:41.680490 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-324afc91-833a-4c37-a384-880bc7b29f8a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.616415 Dec 16 14:39:41.690419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 108/219] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:41 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:42.679292 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-66850b6d-184b-4e4a-b18a-9f958a760b02 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:42.686679 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-66850b6d-184b-4e4a-b18a-9f958a760b02 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:42.734204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1296d986-bdbd-4f92-9e7c-7b30ce61b5fc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:42.735879 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66850b6d-184b-4e4a-b18a-9f958a760b02 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:42.739173 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66850b6d-184b-4e4a-b18a-9f958a760b02 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:42.740735 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1296d986-bdbd-4f92-9e7c-7b30ce61b5fc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:42.741295 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66850b6d-184b-4e4a-b18a-9f958a760b02 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:42.742126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66850b6d-184b-4e4a-b18a-9f958a760b02 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:42.778296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1296d986-bdbd-4f92-9e7c-7b30ce61b5fc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:42.788281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1296d986-bdbd-4f92-9e7c-7b30ce61b5fc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:42.792748 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1296d986-bdbd-4f92-9e7c-7b30ce61b5fc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:42.794037 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1296d986-bdbd-4f92-9e7c-7b30ce61b5fc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:43.032607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1296d986-bdbd-4f92-9e7c-7b30ce61b5fc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.336910 Dec 16 14:39:43.040103 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 109/220] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:42 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:43.139301 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-66850b6d-184b-4e4a-b18a-9f958a760b02 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.499672 Dec 16 14:39:43.140905 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 112/221] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:42 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:39:44.079806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1c3a2318-f0fb-47c8-a0be-eb8685f63173 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:44.082545 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1c3a2318-f0fb-47c8-a0be-eb8685f63173 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:44.106051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1c3a2318-f0fb-47c8-a0be-eb8685f63173 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:44.107014 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1c3a2318-f0fb-47c8-a0be-eb8685f63173 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:44.110721 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1c3a2318-f0fb-47c8-a0be-eb8685f63173 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:44.111747 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1c3a2318-f0fb-47c8-a0be-eb8685f63173 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:44.175085 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2188e514-fb1a-4805-8811-9016377cc7f7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:44.179816 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2188e514-fb1a-4805-8811-9016377cc7f7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:44.208201 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2188e514-fb1a-4805-8811-9016377cc7f7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:44.213728 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2188e514-fb1a-4805-8811-9016377cc7f7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:44.219386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2188e514-fb1a-4805-8811-9016377cc7f7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:44.222641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2188e514-fb1a-4805-8811-9016377cc7f7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:44.392228 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1c3a2318-f0fb-47c8-a0be-eb8685f63173 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.342786 Dec 16 14:39:44.403212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 110/222] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:44 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:44.455377 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2188e514-fb1a-4805-8811-9016377cc7f7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.302797 Dec 16 14:39:44.456423 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 113/223] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:44 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:45.433170 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-64b9efa8-76ae-49c9-be99-090062d60fd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:45.437596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-64b9efa8-76ae-49c9-be99-090062d60fd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:45.455059 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-64b9efa8-76ae-49c9-be99-090062d60fd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.456691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-64b9efa8-76ae-49c9-be99-090062d60fd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:45.458689 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-64b9efa8-76ae-49c9-be99-090062d60fd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.460136 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-64b9efa8-76ae-49c9-be99-090062d60fd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:45.546767 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b36b88c4-8510-45a3-b525-c7c1b25abb94 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:45.557558 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b36b88c4-8510-45a3-b525-c7c1b25abb94 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:45.631535 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b36b88c4-8510-45a3-b525-c7c1b25abb94 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.633709 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b36b88c4-8510-45a3-b525-c7c1b25abb94 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:45.638945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b36b88c4-8510-45a3-b525-c7c1b25abb94 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.639989 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b36b88c4-8510-45a3-b525-c7c1b25abb94 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:45.736529 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-64b9efa8-76ae-49c9-be99-090062d60fd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28133 microversion: 2.20 time: 0.327587 Dec 16 14:39:45.738365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 111/224] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:45 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28133 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:45.896899 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b36b88c4-8510-45a3-b525-c7c1b25abb94 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.426695 Dec 16 14:39:45.900155 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 114/225] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:45 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:46.767223 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ec0e3d9f-8120-4363-b855-cc0e7f2f978b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:46.768536 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ec0e3d9f-8120-4363-b855-cc0e7f2f978b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:46.799156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ec0e3d9f-8120-4363-b855-cc0e7f2f978b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:46.801910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ec0e3d9f-8120-4363-b855-cc0e7f2f978b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:46.802928 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ec0e3d9f-8120-4363-b855-cc0e7f2f978b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:46.803475 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ec0e3d9f-8120-4363-b855-cc0e7f2f978b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:46.983268 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1ed2d152-e1c3-4c9f-b765-5064abe713a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:46.995685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1ed2d152-e1c3-4c9f-b765-5064abe713a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:47.019463 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1ed2d152-e1c3-4c9f-b765-5064abe713a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:47.019463 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1ed2d152-e1c3-4c9f-b765-5064abe713a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:47.019463 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1ed2d152-e1c3-4c9f-b765-5064abe713a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:47.019463 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1ed2d152-e1c3-4c9f-b765-5064abe713a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:47.072272 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ec0e3d9f-8120-4363-b855-cc0e7f2f978b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28276 microversion: 2.20 time: 0.323251 Dec 16 14:39:47.073738 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 112/226] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:46 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28276 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:47.262832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1ed2d152-e1c3-4c9f-b765-5064abe713a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28201 microversion: 2.1 time: 0.351331 Dec 16 14:39:47.265158 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 115/227] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:46 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28201 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:48.095176 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bb7e3a4b-c556-4836-a403-2e282c0c5b91 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:48.097244 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-bb7e3a4b-c556-4836-a403-2e282c0c5b91 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:48.109706 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bb7e3a4b-c556-4836-a403-2e282c0c5b91 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.110496 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bb7e3a4b-c556-4836-a403-2e282c0c5b91 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:48.111508 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bb7e3a4b-c556-4836-a403-2e282c0c5b91 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.112194 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bb7e3a4b-c556-4836-a403-2e282c0c5b91 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:48.280636 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-bb7e3a4b-c556-4836-a403-2e282c0c5b91 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28424 microversion: 2.20 time: 0.199626 Dec 16 14:39:48.281638 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 113/228] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:48 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28424 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:48.317112 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cac26b72-e73d-49f7-bcad-6c4347fb5129 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:48.323143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cac26b72-e73d-49f7-bcad-6c4347fb5129 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:48.360030 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cac26b72-e73d-49f7-bcad-6c4347fb5129 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.363989 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cac26b72-e73d-49f7-bcad-6c4347fb5129 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:48.369349 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cac26b72-e73d-49f7-bcad-6c4347fb5129 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.371426 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cac26b72-e73d-49f7-bcad-6c4347fb5129 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:48.721258 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cac26b72-e73d-49f7-bcad-6c4347fb5129 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28492 microversion: 2.1 time: 0.444012 Dec 16 14:39:48.722957 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 116/229] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:48 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28492 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:39:49.307239 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5d49c6e6-a3bd-476e-bce7-2563b98c114c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:49.308873 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5d49c6e6-a3bd-476e-bce7-2563b98c114c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:49.319571 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5d49c6e6-a3bd-476e-bce7-2563b98c114c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:49.320522 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5d49c6e6-a3bd-476e-bce7-2563b98c114c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:49.321848 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5d49c6e6-a3bd-476e-bce7-2563b98c114c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:49.322523 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5d49c6e6-a3bd-476e-bce7-2563b98c114c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:49.650029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5d49c6e6-a3bd-476e-bce7-2563b98c114c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.354815 Dec 16 14:39:49.651044 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 114/230] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:49 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:49.763226 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-bc57a6e8-787d-49a9-9c29-a2bcc76bf57a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:49.764962 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-bc57a6e8-787d-49a9-9c29-a2bcc76bf57a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:49.794799 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bc57a6e8-787d-49a9-9c29-a2bcc76bf57a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:49.795598 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bc57a6e8-787d-49a9-9c29-a2bcc76bf57a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:49.811025 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bc57a6e8-787d-49a9-9c29-a2bcc76bf57a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:49.812007 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bc57a6e8-787d-49a9-9c29-a2bcc76bf57a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:50.121766 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-bc57a6e8-787d-49a9-9c29-a2bcc76bf57a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.387890 Dec 16 14:39:50.130516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 117/231] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:49 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:50.679855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e43165fd-2e39-4296-a66b-0304507e6726 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:50.681016 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e43165fd-2e39-4296-a66b-0304507e6726 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:50.700096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e43165fd-2e39-4296-a66b-0304507e6726 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:50.700578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e43165fd-2e39-4296-a66b-0304507e6726 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:50.701647 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e43165fd-2e39-4296-a66b-0304507e6726 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:50.702427 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e43165fd-2e39-4296-a66b-0304507e6726 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:50.967977 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e43165fd-2e39-4296-a66b-0304507e6726 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.305884 Dec 16 14:39:50.968646 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 115/232] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:50 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:51.167974 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e74dadb5-606e-4a00-a0c5-40f42585891f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:51.171877 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e74dadb5-606e-4a00-a0c5-40f42585891f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:51.189097 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e74dadb5-606e-4a00-a0c5-40f42585891f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:51.191595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e74dadb5-606e-4a00-a0c5-40f42585891f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:51.193610 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e74dadb5-606e-4a00-a0c5-40f42585891f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:51.194778 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e74dadb5-606e-4a00-a0c5-40f42585891f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:51.453560 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e74dadb5-606e-4a00-a0c5-40f42585891f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.319054 Dec 16 14:39:51.455289 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 118/233] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:51 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:52.021952 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0083dd7b-af50-4536-9a83-66bf1ece7f26 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:52.026475 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0083dd7b-af50-4536-9a83-66bf1ece7f26 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:52.066328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0083dd7b-af50-4536-9a83-66bf1ece7f26 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:52.074793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0083dd7b-af50-4536-9a83-66bf1ece7f26 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:52.076577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0083dd7b-af50-4536-9a83-66bf1ece7f26 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:52.078085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0083dd7b-af50-4536-9a83-66bf1ece7f26 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:52.393022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0083dd7b-af50-4536-9a83-66bf1ece7f26 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.414454 Dec 16 14:39:52.393934 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 116/234] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:51 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:52.486377 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6e2b1a04-9e33-44cf-ba7a-d4006df50b55 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:52.487583 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6e2b1a04-9e33-44cf-ba7a-d4006df50b55 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:52.507853 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6e2b1a04-9e33-44cf-ba7a-d4006df50b55 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:52.508436 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6e2b1a04-9e33-44cf-ba7a-d4006df50b55 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:52.509095 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6e2b1a04-9e33-44cf-ba7a-d4006df50b55 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:52.509638 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6e2b1a04-9e33-44cf-ba7a-d4006df50b55 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:52.848828 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6e2b1a04-9e33-44cf-ba7a-d4006df50b55 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.381785 Dec 16 14:39:52.857041 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 119/235] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:52 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:53.461417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-71872bbf-36f7-4c7d-ab33-8627fbae109b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:53.474627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-71872bbf-36f7-4c7d-ab33-8627fbae109b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:53.504767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-71872bbf-36f7-4c7d-ab33-8627fbae109b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.506087 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-71872bbf-36f7-4c7d-ab33-8627fbae109b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:53.508484 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-71872bbf-36f7-4c7d-ab33-8627fbae109b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.510543 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-71872bbf-36f7-4c7d-ab33-8627fbae109b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:53.765501 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-71872bbf-36f7-4c7d-ab33-8627fbae109b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.351856 Dec 16 14:39:53.787183 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 117/236] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:53 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:53.877160 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8b648300-d07c-442c-ae0c-a9f1cec9a187 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:53.879223 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8b648300-d07c-442c-ae0c-a9f1cec9a187 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:53.904574 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b648300-d07c-442c-ae0c-a9f1cec9a187 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.912254 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b648300-d07c-442c-ae0c-a9f1cec9a187 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:53.913398 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b648300-d07c-442c-ae0c-a9f1cec9a187 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.913904 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b648300-d07c-442c-ae0c-a9f1cec9a187 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:54.198602 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8b648300-d07c-442c-ae0c-a9f1cec9a187 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.337250 Dec 16 14:39:54.200240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 120/237] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:53 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:39:54.796881 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fadc99be-234d-4ab0-b138-a14bec6a8b06 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:54.798454 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fadc99be-234d-4ab0-b138-a14bec6a8b06 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:54.820946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fadc99be-234d-4ab0-b138-a14bec6a8b06 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:54.822635 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fadc99be-234d-4ab0-b138-a14bec6a8b06 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:54.825022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fadc99be-234d-4ab0-b138-a14bec6a8b06 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:54.826466 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fadc99be-234d-4ab0-b138-a14bec6a8b06 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:55.039692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fadc99be-234d-4ab0-b138-a14bec6a8b06 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.259653 Dec 16 14:39:55.040413 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 118/238] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:54 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:39:55.279169 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-68707f7c-76c5-4c68-acb8-53d6c0688de4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:55.281812 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-68707f7c-76c5-4c68-acb8-53d6c0688de4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:55.297794 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-68707f7c-76c5-4c68-acb8-53d6c0688de4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:55.299149 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-68707f7c-76c5-4c68-acb8-53d6c0688de4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:55.300947 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-68707f7c-76c5-4c68-acb8-53d6c0688de4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:55.302269 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-68707f7c-76c5-4c68-acb8-53d6c0688de4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:55.579282 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-68707f7c-76c5-4c68-acb8-53d6c0688de4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.314994 Dec 16 14:39:55.581341 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 121/239] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:55 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:56.079383 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f4fd3946-bc52-4f6a-9cdb-feaf03e756c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:56.083531 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f4fd3946-bc52-4f6a-9cdb-feaf03e756c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:56.108367 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f4fd3946-bc52-4f6a-9cdb-feaf03e756c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:56.109210 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f4fd3946-bc52-4f6a-9cdb-feaf03e756c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:56.114451 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f4fd3946-bc52-4f6a-9cdb-feaf03e756c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:56.115840 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f4fd3946-bc52-4f6a-9cdb-feaf03e756c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:56.412685 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f4fd3946-bc52-4f6a-9cdb-feaf03e756c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.360659 Dec 16 14:39:56.414310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 119/240] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:56 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:56.611927 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e9c23995-5e97-40bc-8813-ee10dbbfb1c6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:56.613844 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e9c23995-5e97-40bc-8813-ee10dbbfb1c6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:56.628229 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e9c23995-5e97-40bc-8813-ee10dbbfb1c6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:56.629181 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e9c23995-5e97-40bc-8813-ee10dbbfb1c6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:56.631523 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e9c23995-5e97-40bc-8813-ee10dbbfb1c6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:56.632898 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e9c23995-5e97-40bc-8813-ee10dbbfb1c6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:56.845081 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e9c23995-5e97-40bc-8813-ee10dbbfb1c6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.255086 Dec 16 14:39:56.846421 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 122/241] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:56 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:39:57.509581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-12fde348-e9d0-42b0-860a-aa69cadeb547 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:57.514787 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-12fde348-e9d0-42b0-860a-aa69cadeb547 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:57.533049 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-12fde348-e9d0-42b0-860a-aa69cadeb547 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:57.543005 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-12fde348-e9d0-42b0-860a-aa69cadeb547 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:57.548223 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-12fde348-e9d0-42b0-860a-aa69cadeb547 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:57.549954 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-12fde348-e9d0-42b0-860a-aa69cadeb547 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:57.770935 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-12fde348-e9d0-42b0-860a-aa69cadeb547 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.278187 Dec 16 14:39:57.771725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 120/242] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:57 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:39:57.874823 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a11ad32f-1036-4322-84e9-c5c1b9292c43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:57.876230 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a11ad32f-1036-4322-84e9-c5c1b9292c43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:57.910464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a11ad32f-1036-4322-84e9-c5c1b9292c43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:57.910464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a11ad32f-1036-4322-84e9-c5c1b9292c43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:57.910464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a11ad32f-1036-4322-84e9-c5c1b9292c43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:57.910464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a11ad32f-1036-4322-84e9-c5c1b9292c43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:58.091448 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a11ad32f-1036-4322-84e9-c5c1b9292c43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.234329 Dec 16 14:39:58.092553 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 121/243] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:57 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:39:58.377792 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2064198642", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26cb6916-dc12-4ad7-9cb0-0782f314f2a9"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:58.502930 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] validate_networks() for [('26cb6916-dc12-4ad7-9cb0-0782f314f2a9', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:39:58.823761 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c8fe1e0d-4fea-43c0-8114-8446e2ea1800 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:58.831577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c8fe1e0d-4fea-43c0-8114-8446e2ea1800 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:58.856161 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8fe1e0d-4fea-43c0-8114-8446e2ea1800 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:58.857455 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8fe1e0d-4fea-43c0-8114-8446e2ea1800 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:58.859360 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8fe1e0d-4fea-43c0-8114-8446e2ea1800 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:58.861022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8fe1e0d-4fea-43c0-8114-8446e2ea1800 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.080539 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c8fe1e0d-4fea-43c0-8114-8446e2ea1800 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.297719 Dec 16 14:39:59.082266 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 122/244] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:39:58 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:39:59.122687 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-01ce4919-08de-4e1a-9a3b-16f6eb2387cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:59.123741 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-01ce4919-08de-4e1a-9a3b-16f6eb2387cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:39:59.151492 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-01ce4919-08de-4e1a-9a3b-16f6eb2387cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.155380 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-01ce4919-08de-4e1a-9a3b-16f6eb2387cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.156648 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-01ce4919-08de-4e1a-9a3b-16f6eb2387cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.162307 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-01ce4919-08de-4e1a-9a3b-16f6eb2387cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.363657 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-01ce4919-08de-4e1a-9a3b-16f6eb2387cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.261135 Dec 16 14:39:59.364347 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 123/245] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:39:59 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:40:00.128993 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ed2b1378-4917-4432-ad2a-71192857d2cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:00.132466 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ed2b1378-4917-4432-ad2a-71192857d2cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:00.151039 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed2b1378-4917-4432-ad2a-71192857d2cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:00.153299 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed2b1378-4917-4432-ad2a-71192857d2cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:00.155059 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed2b1378-4917-4432-ad2a-71192857d2cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:00.156451 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed2b1378-4917-4432-ad2a-71192857d2cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:00.408512 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:40:00.410584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:40:00.411903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:40:00.413092 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:40:00.414126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:40:00.420823 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ed2b1378-4917-4432-ad2a-71192857d2cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.327691 Dec 16 14:40:00.427968 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 124/246] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:00 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:00.449192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:00.449836 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fad1f6f4-8639-4431-8ee8-86fe19a5e185 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:00.451526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fad1f6f4-8639-4431-8ee8-86fe19a5e185 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:00.455027 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:00.457493 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:00.462911 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:00.466726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fad1f6f4-8639-4431-8ee8-86fe19a5e185 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:00.467651 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fad1f6f4-8639-4431-8ee8-86fe19a5e185 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:00.469599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fad1f6f4-8639-4431-8ee8-86fe19a5e185 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:00.470348 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fad1f6f4-8639-4431-8ee8-86fe19a5e185 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:00.532901 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Getting quotas for project c2109a7078ee45b1b922e81c997328cb. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:40:00.542952 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Getting quotas for user f8c9d652402e4465b4820436357bdc72 and project c2109a7078ee45b1b922e81c997328cb. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:40:00.565818 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:40:00.570897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:40:00.680359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fad1f6f4-8639-4431-8ee8-86fe19a5e185 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.247966 Dec 16 14:40:00.681788 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cda3db9d-61d6-4dcb-9ba8-ddef38f6bf3c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.916998 Dec 16 14:40:00.683974 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 125/247] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:00 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:00.701169 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 123/248] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:39:57 2021] POST /compute/v2.1/servers => generated 383 bytes in 2931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:40:00.761249 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-27bea2ac-7685-47c5-ab5c-3338cf3af684 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:00.761701 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-27bea2ac-7685-47c5-ab5c-3338cf3af684 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:01.058588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-27bea2ac-7685-47c5-ab5c-3338cf3af684 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:01.069521 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-27bea2ac-7685-47c5-ab5c-3338cf3af684 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1222 microversion: 2.1 time: 0.376541 Dec 16 14:40:01.084532 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 126/249] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:00 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1222 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:01.469068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c59f5e90-48aa-4387-8908-fccdd08712b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:01.470918 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c59f5e90-48aa-4387-8908-fccdd08712b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:01.495987 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c59f5e90-48aa-4387-8908-fccdd08712b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.497119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c59f5e90-48aa-4387-8908-fccdd08712b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.498757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c59f5e90-48aa-4387-8908-fccdd08712b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.500011 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c59f5e90-48aa-4387-8908-fccdd08712b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.740606 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-33612568-6b65-40c4-a8ce-bd38ded3bf59 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:01.742805 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-33612568-6b65-40c4-a8ce-bd38ded3bf59 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:01.747036 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c59f5e90-48aa-4387-8908-fccdd08712b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.314102 Dec 16 14:40:01.748865 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 124/250] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:01 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:01.772756 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-561314500", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26cb6916-dc12-4ad7-9cb0-0782f314f2a9"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:01.794010 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-33612568-6b65-40c4-a8ce-bd38ded3bf59 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.795113 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-33612568-6b65-40c4-a8ce-bd38ded3bf59 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.797483 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-33612568-6b65-40c4-a8ce-bd38ded3bf59 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.798373 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-33612568-6b65-40c4-a8ce-bd38ded3bf59 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.913041 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] validate_networks() for [('26cb6916-dc12-4ad7-9cb0-0782f314f2a9', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:40:02.178839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-33612568-6b65-40c4-a8ce-bd38ded3bf59 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.486515 Dec 16 14:40:02.179605 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 127/251] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:01 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:02.791597 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fd2ca0fc-7427-449f-8e47-5fc57ebed81f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:02.796006 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fd2ca0fc-7427-449f-8e47-5fc57ebed81f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:02.824618 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fd2ca0fc-7427-449f-8e47-5fc57ebed81f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:02.825911 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fd2ca0fc-7427-449f-8e47-5fc57ebed81f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:02.828395 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fd2ca0fc-7427-449f-8e47-5fc57ebed81f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:02.829142 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fd2ca0fc-7427-449f-8e47-5fc57ebed81f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:03.085149 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fd2ca0fc-7427-449f-8e47-5fc57ebed81f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.325091 Dec 16 14:40:03.086742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 128/252] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:02 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:03.234417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-40b5e797-0bc7-4ee2-8ab6-960bc34afab1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:03.239407 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-40b5e797-0bc7-4ee2-8ab6-960bc34afab1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:03.274993 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40b5e797-0bc7-4ee2-8ab6-960bc34afab1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:03.276870 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40b5e797-0bc7-4ee2-8ab6-960bc34afab1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:03.283295 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40b5e797-0bc7-4ee2-8ab6-960bc34afab1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:03.295685 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40b5e797-0bc7-4ee2-8ab6-960bc34afab1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:03.481037 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-40b5e797-0bc7-4ee2-8ab6-960bc34afab1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.287527 Dec 16 14:40:03.487886 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 129/253] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:03 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:03.976634 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:40:03.978457 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:40:03.979677 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:40:03.980689 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:40:03.981969 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:40:04.040557 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.045186 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.048700 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.054922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.121920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cb7728da-d43a-408d-9ca4-617f0e4a89f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:04.125532 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cb7728da-d43a-408d-9ca4-617f0e4a89f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:04.148280 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cb7728da-d43a-408d-9ca4-617f0e4a89f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.154269 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cb7728da-d43a-408d-9ca4-617f0e4a89f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.158593 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cb7728da-d43a-408d-9ca4-617f0e4a89f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.163633 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cb7728da-d43a-408d-9ca4-617f0e4a89f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.194494 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Getting quotas for project c2109a7078ee45b1b922e81c997328cb. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:40:04.232673 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Getting quotas for user f8c9d652402e4465b4820436357bdc72 and project c2109a7078ee45b1b922e81c997328cb. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:40:04.297028 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:40:04.311155 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:40:04.437471 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cb7728da-d43a-408d-9ca4-617f0e4a89f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.341646 Dec 16 14:40:04.441813 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 130/254] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:04 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:04.510290 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e57bc3f2-de54-4792-83b5-8ebca17f0e58 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:04.516216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e57bc3f2-de54-4792-83b5-8ebca17f0e58 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:04.536725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e57bc3f2-de54-4792-83b5-8ebca17f0e58 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.538768 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e57bc3f2-de54-4792-83b5-8ebca17f0e58 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.542791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e57bc3f2-de54-4792-83b5-8ebca17f0e58 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.545579 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e57bc3f2-de54-4792-83b5-8ebca17f0e58 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.548761 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d6375142-2ff0-4d67-882b-11eba745cd5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.798265 Dec 16 14:40:04.562809 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 125/255] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:40:01 2021] POST /compute/v2.1/servers => generated 383 bytes in 2813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:40:04.634728 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e42f5660-a840-4d20-a8f6-63f0445ea8fb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:04.645484 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e42f5660-a840-4d20-a8f6-63f0445ea8fb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:04.835211 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e57bc3f2-de54-4792-83b5-8ebca17f0e58 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.339498 Dec 16 14:40:04.843605 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 131/256] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:04 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:40:04.950540 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e42f5660-a840-4d20-a8f6-63f0445ea8fb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:04.963814 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e42f5660-a840-4d20-a8f6-63f0445ea8fb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1221 microversion: 2.1 time: 0.398982 Dec 16 14:40:04.965177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 126/257] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:04 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1221 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:05.468807 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9b993bc1-46cc-483c-b132-a09c21c9714f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:05.480883 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9b993bc1-46cc-483c-b132-a09c21c9714f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:05.508418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9b993bc1-46cc-483c-b132-a09c21c9714f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:05.508882 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9b993bc1-46cc-483c-b132-a09c21c9714f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:05.509725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9b993bc1-46cc-483c-b132-a09c21c9714f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:05.510243 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9b993bc1-46cc-483c-b132-a09c21c9714f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:05.783211 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9b993bc1-46cc-483c-b132-a09c21c9714f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.335900 Dec 16 14:40:05.785460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 132/258] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:05 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:05.895512 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-598c0258-7162-497a-b789-7404c3e9a465 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:05.897305 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-598c0258-7162-497a-b789-7404c3e9a465 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:05.950749 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-598c0258-7162-497a-b789-7404c3e9a465 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:05.951541 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-598c0258-7162-497a-b789-7404c3e9a465 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:05.953212 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-598c0258-7162-497a-b789-7404c3e9a465 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:05.953977 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-598c0258-7162-497a-b789-7404c3e9a465 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:06.011105 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bdcc832c-c82e-45ef-a4c7-d126f47e3337 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:06.020856 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-bdcc832c-c82e-45ef-a4c7-d126f47e3337 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:06.041581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bdcc832c-c82e-45ef-a4c7-d126f47e3337 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:06.042502 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bdcc832c-c82e-45ef-a4c7-d126f47e3337 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:06.043737 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bdcc832c-c82e-45ef-a4c7-d126f47e3337 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:06.050481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bdcc832c-c82e-45ef-a4c7-d126f47e3337 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:06.510970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-598c0258-7162-497a-b789-7404c3e9a465 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.663100 Dec 16 14:40:06.512122 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 127/259] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:05 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:06.674455 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bdcc832c-c82e-45ef-a4c7-d126f47e3337 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:06.727201 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-bdcc832c-c82e-45ef-a4c7-d126f47e3337 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1217 microversion: 2.1 time: 0.726445 Dec 16 14:40:06.729384 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 133/260] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:05 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1217 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:06.855660 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-afdeab05-3eeb-4a5d-a249-949a4cb68578 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:06.863293 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-afdeab05-3eeb-4a5d-a249-949a4cb68578 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:06.904227 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-afdeab05-3eeb-4a5d-a249-949a4cb68578 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:06.905285 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-afdeab05-3eeb-4a5d-a249-949a4cb68578 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:06.907127 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-afdeab05-3eeb-4a5d-a249-949a4cb68578 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:06.907945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-afdeab05-3eeb-4a5d-a249-949a4cb68578 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:07.309242 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-afdeab05-3eeb-4a5d-a249-949a4cb68578 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.505365 Dec 16 14:40:07.310597 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 128/261] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:06 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:07.566040 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-24ae55eb-b458-4964-becc-da5d1411129b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:07.567717 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-24ae55eb-b458-4964-becc-da5d1411129b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:07.652914 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-24ae55eb-b458-4964-becc-da5d1411129b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.652914 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-24ae55eb-b458-4964-becc-da5d1411129b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:07.653163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-24ae55eb-b458-4964-becc-da5d1411129b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.653621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-24ae55eb-b458-4964-becc-da5d1411129b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:07.795995 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ddda94c9-466c-4db4-8d18-659bc0ae3768 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:07.807685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ddda94c9-466c-4db4-8d18-659bc0ae3768 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:07.860610 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ddda94c9-466c-4db4-8d18-659bc0ae3768 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.861198 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ddda94c9-466c-4db4-8d18-659bc0ae3768 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:07.862712 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ddda94c9-466c-4db4-8d18-659bc0ae3768 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.863490 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ddda94c9-466c-4db4-8d18-659bc0ae3768 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:08.071382 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-24ae55eb-b458-4964-becc-da5d1411129b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.546878 Dec 16 14:40:08.077143 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 134/262] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:07 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:08.320225 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ddda94c9-466c-4db4-8d18-659bc0ae3768 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:08.336147 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8cf15a3b-2ce3-499d-b84a-587cd94cbeb1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:08.337650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8cf15a3b-2ce3-499d-b84a-587cd94cbeb1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:08.349832 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8cf15a3b-2ce3-499d-b84a-587cd94cbeb1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:08.350417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8cf15a3b-2ce3-499d-b84a-587cd94cbeb1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:08.351355 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8cf15a3b-2ce3-499d-b84a-587cd94cbeb1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:08.352276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8cf15a3b-2ce3-499d-b84a-587cd94cbeb1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:08.355233 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ddda94c9-466c-4db4-8d18-659bc0ae3768 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1291 microversion: 2.1 time: 0.597230 Dec 16 14:40:08.359014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 129/263] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:07 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1291 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:08.525686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8cf15a3b-2ce3-499d-b84a-587cd94cbeb1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.204210 Dec 16 14:40:08.526400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 135/264] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:08 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:09.101747 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f32a3c1b-1fd3-4676-ab06-dcab46ac9d1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:09.102728 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f32a3c1b-1fd3-4676-ab06-dcab46ac9d1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:09.129526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f32a3c1b-1fd3-4676-ab06-dcab46ac9d1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.131566 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f32a3c1b-1fd3-4676-ab06-dcab46ac9d1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:09.133066 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f32a3c1b-1fd3-4676-ab06-dcab46ac9d1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.136262 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f32a3c1b-1fd3-4676-ab06-dcab46ac9d1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:09.435496 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a2815383-a10b-4c56-b0f8-f8a918638782 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:09.436575 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a2815383-a10b-4c56-b0f8-f8a918638782 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:09.465464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a2815383-a10b-4c56-b0f8-f8a918638782 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.469310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a2815383-a10b-4c56-b0f8-f8a918638782 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:09.473716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a2815383-a10b-4c56-b0f8-f8a918638782 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.477579 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a2815383-a10b-4c56-b0f8-f8a918638782 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:09.536667 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f32a3c1b-1fd3-4676-ab06-dcab46ac9d1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.451051 Dec 16 14:40:09.538213 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 130/265] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:09 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:09.606861 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-561d6702-4cd1-4def-abdb-1db6d096558d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:09.626850 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-561d6702-4cd1-4def-abdb-1db6d096558d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:09.675705 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-561d6702-4cd1-4def-abdb-1db6d096558d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.678630 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-561d6702-4cd1-4def-abdb-1db6d096558d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:09.688664 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-561d6702-4cd1-4def-abdb-1db6d096558d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.692828 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-561d6702-4cd1-4def-abdb-1db6d096558d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:10.003243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-561d6702-4cd1-4def-abdb-1db6d096558d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.462324 Dec 16 14:40:10.004126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 131/266] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:09 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:10.112928 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a2815383-a10b-4c56-b0f8-f8a918638782 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:10.176099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a2815383-a10b-4c56-b0f8-f8a918638782 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1279 microversion: 2.1 time: 0.798816 Dec 16 14:40:10.182054 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 136/267] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:09 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1279 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:10.489017 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-9b823d82-7770-4c4e-992f-5efbe8f984e6 req-2fdfa0ab-621a-43b9-96ba-ccb743757ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618e7310-603e-4003-b2d6-b05eb18cd558", "tag": "a57d57e1-1c2b-4139-ae4f-0870a2d2619a"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:10.535742 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:10.535742 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:40:10.561129 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e48a7ac0-2b9e-40a1-b8be-777e75e95afe tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:10.561129 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e48a7ac0-2b9e-40a1-b8be-777e75e95afe tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:10.566195 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-9b823d82-7770-4c4e-992f-5efbe8f984e6 req-2fdfa0ab-621a-43b9-96ba-ccb743757ee5 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:10.566962 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-9b823d82-7770-4c4e-992f-5efbe8f984e6 req-2fdfa0ab-621a-43b9-96ba-ccb743757ee5 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:10.603598 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e48a7ac0-2b9e-40a1-b8be-777e75e95afe tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:10.605185 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e48a7ac0-2b9e-40a1-b8be-777e75e95afe tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:10.605522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-9b823d82-7770-4c4e-992f-5efbe8f984e6 req-2fdfa0ab-621a-43b9-96ba-ccb743757ee5 service nova] Creating event network-changed:a57d57e1-1c2b-4139-ae4f-0870a2d2619a for instance 618e7310-603e-4003-b2d6-b05eb18cd558 on hv-cinder-82189 Dec 16 14:40:10.608234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e48a7ac0-2b9e-40a1-b8be-777e75e95afe tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:10.615653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e48a7ac0-2b9e-40a1-b8be-777e75e95afe tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:10.652120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-9b823d82-7770-4c4e-992f-5efbe8f984e6 req-2fdfa0ab-621a-43b9-96ba-ccb743757ee5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207656 Dec 16 14:40:10.666388 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 132/268] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:11.053919 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-de5c61a5-842f-499c-9579-dde92a6d8e21 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:11.062749 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-de5c61a5-842f-499c-9579-dde92a6d8e21 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:11.091422 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-de5c61a5-842f-499c-9579-dde92a6d8e21 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.096014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-de5c61a5-842f-499c-9579-dde92a6d8e21 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.097741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-de5c61a5-842f-499c-9579-dde92a6d8e21 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.098703 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-de5c61a5-842f-499c-9579-dde92a6d8e21 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.134869 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e48a7ac0-2b9e-40a1-b8be-777e75e95afe tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.586023 Dec 16 14:40:11.136183 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 137/269] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:10 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:11.213199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-170da803-2d95-442d-ae9c-7865f02e8518 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:11.214883 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-170da803-2d95-442d-ae9c-7865f02e8518 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:11.226262 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-170da803-2d95-442d-ae9c-7865f02e8518 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.226262 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-170da803-2d95-442d-ae9c-7865f02e8518 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.228018 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-170da803-2d95-442d-ae9c-7865f02e8518 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.228815 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-170da803-2d95-442d-ae9c-7865f02e8518 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.315841 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-de5c61a5-842f-499c-9579-dde92a6d8e21 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.297527 Dec 16 14:40:11.319419 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 133/270] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:11 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:11.755890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-170da803-2d95-442d-ae9c-7865f02e8518 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:11.776933 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-170da803-2d95-442d-ae9c-7865f02e8518 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.575173 Dec 16 14:40:11.777572 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 138/271] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:11 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:12.177085 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f0ef2574-a141-4df0-a049-6ca62b8a4a79 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:12.178810 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f0ef2574-a141-4df0-a049-6ca62b8a4a79 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:12.212855 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0ef2574-a141-4df0-a049-6ca62b8a4a79 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:12.213569 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0ef2574-a141-4df0-a049-6ca62b8a4a79 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:12.214887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0ef2574-a141-4df0-a049-6ca62b8a4a79 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:12.215713 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0ef2574-a141-4df0-a049-6ca62b8a4a79 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:12.356052 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c0ab724b-35c4-45cd-97c3-040024d82ca9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:12.357147 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c0ab724b-35c4-45cd-97c3-040024d82ca9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:12.385672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c0ab724b-35c4-45cd-97c3-040024d82ca9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:12.386217 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c0ab724b-35c4-45cd-97c3-040024d82ca9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:12.387470 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c0ab724b-35c4-45cd-97c3-040024d82ca9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:12.387470 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c0ab724b-35c4-45cd-97c3-040024d82ca9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:12.469435 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f0ef2574-a141-4df0-a049-6ca62b8a4a79 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.320162 Dec 16 14:40:12.471188 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 134/272] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:12 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:12.589718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c0ab724b-35c4-45cd-97c3-040024d82ca9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.259110 Dec 16 14:40:12.591650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 139/273] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:12 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:12.836208 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-578f8a86-8c70-4c5d-b9b9-ba9f8140c87e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:12.839780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-578f8a86-8c70-4c5d-b9b9-ba9f8140c87e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:12.867013 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-578f8a86-8c70-4c5d-b9b9-ba9f8140c87e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:12.867952 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-578f8a86-8c70-4c5d-b9b9-ba9f8140c87e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:12.870318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-578f8a86-8c70-4c5d-b9b9-ba9f8140c87e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:12.871513 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-578f8a86-8c70-4c5d-b9b9-ba9f8140c87e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:13.498300 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-41853bbe-ca42-4483-9996-69da3d45fa65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:13.500550 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-41853bbe-ca42-4483-9996-69da3d45fa65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:13.523479 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41853bbe-ca42-4483-9996-69da3d45fa65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:13.524743 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41853bbe-ca42-4483-9996-69da3d45fa65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:13.526465 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41853bbe-ca42-4483-9996-69da3d45fa65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:13.527650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41853bbe-ca42-4483-9996-69da3d45fa65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:13.810753 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-41853bbe-ca42-4483-9996-69da3d45fa65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.327991 Dec 16 14:40:13.816802 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 140/274] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:13 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:40:13.826460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1b61554b-eb03-4808-ab3a-8cb61334e1e0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:13.827726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1b61554b-eb03-4808-ab3a-8cb61334e1e0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:13.841138 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1b61554b-eb03-4808-ab3a-8cb61334e1e0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:13.841694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1b61554b-eb03-4808-ab3a-8cb61334e1e0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:13.842596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1b61554b-eb03-4808-ab3a-8cb61334e1e0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:13.843639 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1b61554b-eb03-4808-ab3a-8cb61334e1e0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:14.031333 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1b61554b-eb03-4808-ab3a-8cb61334e1e0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.216846 Dec 16 14:40:14.032746 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 141/275] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:13 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:14.145395 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-578f8a86-8c70-4c5d-b9b9-ba9f8140c87e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:14.183915 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-578f8a86-8c70-4c5d-b9b9-ba9f8140c87e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 1.387139 Dec 16 14:40:14.189472 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 135/276] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:12 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:14.319538 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-ff3486bb-59b3-4d16-b02f-e959d45a6cbe req-d0ee5014-4115-477a-9e4b-bdad890dd708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6662dea-31e0-4386-ab0f-3fe74bcf7ac0", "tag": "9127d9e7-040f-4d49-ba17-2bc54c53879b"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:14.327328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:14.327328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:40:14.338304 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-ff3486bb-59b3-4d16-b02f-e959d45a6cbe req-d0ee5014-4115-477a-9e4b-bdad890dd708 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:14.338835 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-ff3486bb-59b3-4d16-b02f-e959d45a6cbe req-d0ee5014-4115-477a-9e4b-bdad890dd708 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:14.360757 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-ff3486bb-59b3-4d16-b02f-e959d45a6cbe req-d0ee5014-4115-477a-9e4b-bdad890dd708 service nova] Creating event network-changed:9127d9e7-040f-4d49-ba17-2bc54c53879b for instance d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 on hv-cinder-82189 Dec 16 14:40:14.366016 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-ff3486bb-59b3-4d16-b02f-e959d45a6cbe req-d0ee5014-4115-477a-9e4b-bdad890dd708 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060340 Dec 16 14:40:14.367165 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 142/277] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:14.849604 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ba92a86b-6a23-412d-9f03-2cd7966476f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:14.852315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ba92a86b-6a23-412d-9f03-2cd7966476f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:14.870501 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba92a86b-6a23-412d-9f03-2cd7966476f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:14.872454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba92a86b-6a23-412d-9f03-2cd7966476f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:14.874538 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba92a86b-6a23-412d-9f03-2cd7966476f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:14.878963 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba92a86b-6a23-412d-9f03-2cd7966476f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:15.058706 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2f4bedab-042d-4f6f-a97c-a21c375caa9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:15.060630 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2f4bedab-042d-4f6f-a97c-a21c375caa9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:15.112795 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f4bedab-042d-4f6f-a97c-a21c375caa9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:15.113431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f4bedab-042d-4f6f-a97c-a21c375caa9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:15.114519 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f4bedab-042d-4f6f-a97c-a21c375caa9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:15.115040 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f4bedab-042d-4f6f-a97c-a21c375caa9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:15.250180 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ba92a86b-6a23-412d-9f03-2cd7966476f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.427258 Dec 16 14:40:15.252932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 136/278] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:14 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:15.296940 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9a44ae0d-a84e-40ee-b5ec-e785dc74d8fa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:15.298604 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9a44ae0d-a84e-40ee-b5ec-e785dc74d8fa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:15.334534 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9a44ae0d-a84e-40ee-b5ec-e785dc74d8fa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:15.337776 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9a44ae0d-a84e-40ee-b5ec-e785dc74d8fa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:15.342570 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9a44ae0d-a84e-40ee-b5ec-e785dc74d8fa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:15.346375 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9a44ae0d-a84e-40ee-b5ec-e785dc74d8fa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:15.435992 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2f4bedab-042d-4f6f-a97c-a21c375caa9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.393420 Dec 16 14:40:15.437726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 143/279] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:15 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:16.115281 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9a44ae0d-a84e-40ee-b5ec-e785dc74d8fa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:16.147594 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9a44ae0d-a84e-40ee-b5ec-e785dc74d8fa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.892123 Dec 16 14:40:16.168068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 137/280] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:15 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:16.296378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7b4d8099-a2a0-4538-98aa-432715890958 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:16.303029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7b4d8099-a2a0-4538-98aa-432715890958 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:16.344473 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7b4d8099-a2a0-4538-98aa-432715890958 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.346872 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7b4d8099-a2a0-4538-98aa-432715890958 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.350763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7b4d8099-a2a0-4538-98aa-432715890958 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.351958 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7b4d8099-a2a0-4538-98aa-432715890958 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.483516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9daabd91-74cd-4b97-afed-5eb857c2bb36 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:16.486670 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9daabd91-74cd-4b97-afed-5eb857c2bb36 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:16.503944 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9daabd91-74cd-4b97-afed-5eb857c2bb36 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.505104 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9daabd91-74cd-4b97-afed-5eb857c2bb36 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.506817 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9daabd91-74cd-4b97-afed-5eb857c2bb36 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.507777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9daabd91-74cd-4b97-afed-5eb857c2bb36 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.612009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7b4d8099-a2a0-4538-98aa-432715890958 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.348779 Dec 16 14:40:16.613192 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 144/281] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:16 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:16.842770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9daabd91-74cd-4b97-afed-5eb857c2bb36 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.390814 Dec 16 14:40:16.845191 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 138/282] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:16 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:17.217586 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-78090666-70f9-4ec1-9471-e77c41be231c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:17.221825 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-78090666-70f9-4ec1-9471-e77c41be231c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:17.265819 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-78090666-70f9-4ec1-9471-e77c41be231c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.266930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-78090666-70f9-4ec1-9471-e77c41be231c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.268379 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-78090666-70f9-4ec1-9471-e77c41be231c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.269293 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-78090666-70f9-4ec1-9471-e77c41be231c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.650702 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-bdd3b36b-0824-46e3-ac9f-6b7cd1a77f30 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:17.652710 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-bdd3b36b-0824-46e3-ac9f-6b7cd1a77f30 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:17.669616 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bdd3b36b-0824-46e3-ac9f-6b7cd1a77f30 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.671094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bdd3b36b-0824-46e3-ac9f-6b7cd1a77f30 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.674291 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bdd3b36b-0824-46e3-ac9f-6b7cd1a77f30 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.675863 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bdd3b36b-0824-46e3-ac9f-6b7cd1a77f30 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.723611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-78090666-70f9-4ec1-9471-e77c41be231c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:17.738147 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-78090666-70f9-4ec1-9471-e77c41be231c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.567007 Dec 16 14:40:17.739240 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 145/283] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:17 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:17.887952 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fe2655ee-20fb-4c36-9506-8cefa33890f3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:17.889657 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fe2655ee-20fb-4c36-9506-8cefa33890f3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:17.909786 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe2655ee-20fb-4c36-9506-8cefa33890f3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.910489 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe2655ee-20fb-4c36-9506-8cefa33890f3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.912594 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe2655ee-20fb-4c36-9506-8cefa33890f3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.913423 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe2655ee-20fb-4c36-9506-8cefa33890f3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:18.017116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-bdd3b36b-0824-46e3-ac9f-6b7cd1a77f30 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.392574 Dec 16 14:40:18.019508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 139/284] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:17 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:18.090493 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fe2655ee-20fb-4c36-9506-8cefa33890f3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.233911 Dec 16 14:40:18.091789 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 146/285] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:17 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:18.294698 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-501387101", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "networks": [{"uuid": "5539b773-8751-4335-a9ea-a6672167e589"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:18.418849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] validate_networks() for [('5539b773-8751-4335-a9ea-a6672167e589', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:40:18.775541 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f1485fe7-aba6-4320-b0a1-3a63a69a3327 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:18.776593 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f1485fe7-aba6-4320-b0a1-3a63a69a3327 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:18.792696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1485fe7-aba6-4320-b0a1-3a63a69a3327 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:18.793454 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1485fe7-aba6-4320-b0a1-3a63a69a3327 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:18.795050 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1485fe7-aba6-4320-b0a1-3a63a69a3327 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:18.795809 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1485fe7-aba6-4320-b0a1-3a63a69a3327 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:19.136041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f1485fe7-aba6-4320-b0a1-3a63a69a3327 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:19.146781 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f1485fe7-aba6-4320-b0a1-3a63a69a3327 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.391249 Dec 16 14:40:19.158933 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 147/286] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:18 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:19.158933 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-181db3e5-50bb-4f34-95a0-0bc02a6c8803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:19.159935 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-181db3e5-50bb-4f34-95a0-0bc02a6c8803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:19.169073 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-181db3e5-50bb-4f34-95a0-0bc02a6c8803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:19.169559 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-181db3e5-50bb-4f34-95a0-0bc02a6c8803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:19.170445 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-181db3e5-50bb-4f34-95a0-0bc02a6c8803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:19.170874 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-181db3e5-50bb-4f34-95a0-0bc02a6c8803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:19.177160 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:40:19.178398 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:40:19.179676 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:40:19.180551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:40:19.181507 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:40:19.208561 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:19.210176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:19.211939 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:19.212908 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:19.259771 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Getting quotas for project 755abf4383dc4d3ca3ec465e631d8684. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:40:19.267997 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Getting quotas for user f642c76a379d43fe97078fb43b7477dc and project 755abf4383dc4d3ca3ec465e631d8684. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:40:19.291926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:40:19.297072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:40:19.311202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-181db3e5-50bb-4f34-95a0-0bc02a6c8803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.161542 Dec 16 14:40:19.312998 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 148/287] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:19 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:19.333790 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0ab49bd5-3d07-42d0-b932-c728c8a8fc90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:19.335641 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0ab49bd5-3d07-42d0-b932-c728c8a8fc90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:19.350658 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ab49bd5-3d07-42d0-b932-c728c8a8fc90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:19.351372 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ab49bd5-3d07-42d0-b932-c728c8a8fc90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:19.352816 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ab49bd5-3d07-42d0-b932-c728c8a8fc90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:19.373652 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ab49bd5-3d07-42d0-b932-c728c8a8fc90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:19.429454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-badd5edf-1a55-4140-a15a-3040e886306c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.155550 Dec 16 14:40:19.441647 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 140/288] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:40:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:40:19.474892 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a31160a4-d207-49be-b4cc-050bd43b2d75 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:19.476916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a31160a4-d207-49be-b4cc-050bd43b2d75 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:19.623179 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0ab49bd5-3d07-42d0-b932-c728c8a8fc90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.307496 Dec 16 14:40:19.626673 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 149/289] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:19 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:19.697409 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a31160a4-d207-49be-b4cc-050bd43b2d75 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:19.708958 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a31160a4-d207-49be-b4cc-050bd43b2d75 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1213 microversion: 2.1 time: 0.263891 Dec 16 14:40:19.709924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 141/290] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:19 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1213 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:20.183555 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fab20e1a-9a6b-4c5a-bc11-eeff1e7a514a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:20.192216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fab20e1a-9a6b-4c5a-bc11-eeff1e7a514a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:20.216617 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fab20e1a-9a6b-4c5a-bc11-eeff1e7a514a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.218973 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fab20e1a-9a6b-4c5a-bc11-eeff1e7a514a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.222549 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fab20e1a-9a6b-4c5a-bc11-eeff1e7a514a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.223688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fab20e1a-9a6b-4c5a-bc11-eeff1e7a514a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.333807 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-831e1452-a84f-4a47-bc26-77d954099ef2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:20.337797 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-831e1452-a84f-4a47-bc26-77d954099ef2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:20.363918 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-831e1452-a84f-4a47-bc26-77d954099ef2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.364906 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-831e1452-a84f-4a47-bc26-77d954099ef2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.366127 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-831e1452-a84f-4a47-bc26-77d954099ef2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.367043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-831e1452-a84f-4a47-bc26-77d954099ef2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.637325 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-fab20e1a-9a6b-4c5a-bc11-eeff1e7a514a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:20.656743 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fab20e1a-9a6b-4c5a-bc11-eeff1e7a514a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.486092 Dec 16 14:40:20.658823 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 150/291] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:20 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:20.681751 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8ad584dc-9595-4ccb-a00a-7cc2064e8d3a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:20.684198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8ad584dc-9595-4ccb-a00a-7cc2064e8d3a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:20.700663 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8ad584dc-9595-4ccb-a00a-7cc2064e8d3a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.701520 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8ad584dc-9595-4ccb-a00a-7cc2064e8d3a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.703184 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8ad584dc-9595-4ccb-a00a-7cc2064e8d3a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.704432 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8ad584dc-9595-4ccb-a00a-7cc2064e8d3a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.885366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8ad584dc-9595-4ccb-a00a-7cc2064e8d3a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.223112 Dec 16 14:40:20.887762 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 151/292] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:20 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:20.909755 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-831e1452-a84f-4a47-bc26-77d954099ef2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.589517 Dec 16 14:40:20.911291 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 142/293] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:20 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:40:20.913697 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-195cc1c7-d9f4-4317-abd1-82c559b3a0ff tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:20.915024 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-195cc1c7-d9f4-4317-abd1-82c559b3a0ff tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:20.932256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-195cc1c7-d9f4-4317-abd1-82c559b3a0ff tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.933392 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-195cc1c7-d9f4-4317-abd1-82c559b3a0ff tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.934800 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-195cc1c7-d9f4-4317-abd1-82c559b3a0ff tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.936430 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-195cc1c7-d9f4-4317-abd1-82c559b3a0ff tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:21.127884 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-195cc1c7-d9f4-4317-abd1-82c559b3a0ff tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:21.137652 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-195cc1c7-d9f4-4317-abd1-82c559b3a0ff tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1265 microversion: 2.1 time: 0.247516 Dec 16 14:40:21.148189 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 152/294] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:20 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:21.522977 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-a14a03ea-4aac-45f7-b627-a49f832c29fe req-ef737e82-e24b-4027-a1b0-2083b8ee89c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618e7310-603e-4003-b2d6-b05eb18cd558", "name": "network-vif-plugged", "status": "completed", "tag": "a57d57e1-1c2b-4139-ae4f-0870a2d2619a"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:21.574237 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:21.574237 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:40:21.618134 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-a14a03ea-4aac-45f7-b627-a49f832c29fe req-ef737e82-e24b-4027-a1b0-2083b8ee89c7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:21.619226 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-a14a03ea-4aac-45f7-b627-a49f832c29fe req-ef737e82-e24b-4027-a1b0-2083b8ee89c7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:21.673331 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-a14a03ea-4aac-45f7-b627-a49f832c29fe req-ef737e82-e24b-4027-a1b0-2083b8ee89c7 service nova] Creating event network-vif-plugged:a57d57e1-1c2b-4139-ae4f-0870a2d2619a for instance 618e7310-603e-4003-b2d6-b05eb18cd558 on hv-cinder-82189 Dec 16 14:40:21.688960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-a14a03ea-4aac-45f7-b627-a49f832c29fe req-ef737e82-e24b-4027-a1b0-2083b8ee89c7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195507 Dec 16 14:40:21.690526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 143/295] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:21.693111 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-39827bb6-d4cc-4dad-ab61-12423395e9bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:21.693932 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-39827bb6-d4cc-4dad-ab61-12423395e9bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:21.709943 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-39827bb6-d4cc-4dad-ab61-12423395e9bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:21.710773 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-39827bb6-d4cc-4dad-ab61-12423395e9bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:21.712393 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-39827bb6-d4cc-4dad-ab61-12423395e9bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:21.713246 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-39827bb6-d4cc-4dad-ab61-12423395e9bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:21.915368 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0ef7a8c5-bb3e-4af0-be62-1b67bfcd7e4b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:21.916431 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0ef7a8c5-bb3e-4af0-be62-1b67bfcd7e4b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:21.939555 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0ef7a8c5-bb3e-4af0-be62-1b67bfcd7e4b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:21.948724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0ef7a8c5-bb3e-4af0-be62-1b67bfcd7e4b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:21.949584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0ef7a8c5-bb3e-4af0-be62-1b67bfcd7e4b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:21.950122 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0ef7a8c5-bb3e-4af0-be62-1b67bfcd7e4b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.231047 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0ef7a8c5-bb3e-4af0-be62-1b67bfcd7e4b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.334230 Dec 16 14:40:22.232300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 144/296] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:21 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:22.263338 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4c5db6fc-afc7-4b49-ade9-0f01bcdcc991 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:22.291406 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4c5db6fc-afc7-4b49-ade9-0f01bcdcc991 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:22.308355 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4c5db6fc-afc7-4b49-ade9-0f01bcdcc991 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.310104 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4c5db6fc-afc7-4b49-ade9-0f01bcdcc991 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.311657 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4c5db6fc-afc7-4b49-ade9-0f01bcdcc991 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.312769 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4c5db6fc-afc7-4b49-ade9-0f01bcdcc991 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.521159 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-39827bb6-d4cc-4dad-ab61-12423395e9bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:22.533824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-39827bb6-d4cc-4dad-ab61-12423395e9bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.851631 Dec 16 14:40:22.534636 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 153/297] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:21 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:22.568757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4c5db6fc-afc7-4b49-ade9-0f01bcdcc991 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.326257 Dec 16 14:40:22.573848 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 145/298] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:22 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:22.582222 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-73073099-5bc2-4eb8-a8f4-0f580c7d0ec0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:22.587610 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-73073099-5bc2-4eb8-a8f4-0f580c7d0ec0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:22.608653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-73073099-5bc2-4eb8-a8f4-0f580c7d0ec0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.609522 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-73073099-5bc2-4eb8-a8f4-0f580c7d0ec0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.612647 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-73073099-5bc2-4eb8-a8f4-0f580c7d0ec0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.646073 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-73073099-5bc2-4eb8-a8f4-0f580c7d0ec0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.971378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-73073099-5bc2-4eb8-a8f4-0f580c7d0ec0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:22.986959 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-73073099-5bc2-4eb8-a8f4-0f580c7d0ec0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1271 microversion: 2.1 time: 0.429506 Dec 16 14:40:22.988579 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 154/299] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:22 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1271 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:23.256093 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4613472f-5931-4852-bec0-79d2d0949b9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:23.257301 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4613472f-5931-4852-bec0-79d2d0949b9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:23.268565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4613472f-5931-4852-bec0-79d2d0949b9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.268933 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4613472f-5931-4852-bec0-79d2d0949b9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.270510 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4613472f-5931-4852-bec0-79d2d0949b9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.271094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4613472f-5931-4852-bec0-79d2d0949b9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.546361 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4613472f-5931-4852-bec0-79d2d0949b9e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.303962 Dec 16 14:40:23.549096 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 146/300] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:23 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:23.568493 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4c4f642e-c37c-4c71-a323-99309350d25b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:23.569712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4c4f642e-c37c-4c71-a323-99309350d25b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:23.583095 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c4f642e-c37c-4c71-a323-99309350d25b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.583095 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c4f642e-c37c-4c71-a323-99309350d25b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.590743 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c4f642e-c37c-4c71-a323-99309350d25b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.590743 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c4f642e-c37c-4c71-a323-99309350d25b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.591167 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d5674ae8-de78-417a-bd66-5ec7b7a5e400 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:23.592253 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d5674ae8-de78-417a-bd66-5ec7b7a5e400 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:23.602575 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5674ae8-de78-417a-bd66-5ec7b7a5e400 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.603016 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5674ae8-de78-417a-bd66-5ec7b7a5e400 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.604043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5674ae8-de78-417a-bd66-5ec7b7a5e400 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.604485 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5674ae8-de78-417a-bd66-5ec7b7a5e400 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:24.084195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4c4f642e-c37c-4c71-a323-99309350d25b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:24.109803 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4c4f642e-c37c-4c71-a323-99309350d25b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.557925 Dec 16 14:40:24.111722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 155/301] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:23 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:24.135791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4c60f599-a50e-4bf4-b075-a0a08b336d14 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:24.136949 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4c60f599-a50e-4bf4-b075-a0a08b336d14 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:24.153017 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c60f599-a50e-4bf4-b075-a0a08b336d14 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.153808 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c60f599-a50e-4bf4-b075-a0a08b336d14 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:24.155398 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c60f599-a50e-4bf4-b075-a0a08b336d14 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.156192 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4c60f599-a50e-4bf4-b075-a0a08b336d14 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:24.646327 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4c60f599-a50e-4bf4-b075-a0a08b336d14 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:24.671456 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4c60f599-a50e-4bf4-b075-a0a08b336d14 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.557653 Dec 16 14:40:24.672569 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 156/302] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:24 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:24.691215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-86e09d01-22bd-40ed-b40c-051b9f78248d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:24.692759 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-86e09d01-22bd-40ed-b40c-051b9f78248d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:24.707873 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86e09d01-22bd-40ed-b40c-051b9f78248d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.709127 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86e09d01-22bd-40ed-b40c-051b9f78248d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:24.710615 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86e09d01-22bd-40ed-b40c-051b9f78248d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.711374 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86e09d01-22bd-40ed-b40c-051b9f78248d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.104492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d5674ae8-de78-417a-bd66-5ec7b7a5e400 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 3.524745 Dec 16 14:40:27.113744 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 147/303] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:23 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 3535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:40:27.124365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-86e09d01-22bd-40ed-b40c-051b9f78248d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 2.449333 Dec 16 14:40:27.125920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 157/304] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:24 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:27.144774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-66275546-88a3-4b8b-a7d4-45386edbe61a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:27.146477 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-66275546-88a3-4b8b-a7d4-45386edbe61a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:27.151732 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-5dc10869-017a-4f36-88ef-7b070310fa8c req-d9ba9a7e-c1e3-42c2-9a40-fcac27d92951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc", "tag": "6978c6aa-5ee8-4ed8-9bd4-c826607ba4ff"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:27.163202 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66275546-88a3-4b8b-a7d4-45386edbe61a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.164410 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66275546-88a3-4b8b-a7d4-45386edbe61a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.166737 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66275546-88a3-4b8b-a7d4-45386edbe61a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.167807 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66275546-88a3-4b8b-a7d4-45386edbe61a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.168742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:27.168742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:40:27.187238 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5dc10869-017a-4f36-88ef-7b070310fa8c req-d9ba9a7e-c1e3-42c2-9a40-fcac27d92951 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.188622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5dc10869-017a-4f36-88ef-7b070310fa8c req-d9ba9a7e-c1e3-42c2-9a40-fcac27d92951 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.229722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-5dc10869-017a-4f36-88ef-7b070310fa8c req-d9ba9a7e-c1e3-42c2-9a40-fcac27d92951 service nova] Creating event network-changed:6978c6aa-5ee8-4ed8-9bd4-c826607ba4ff for instance b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc on hv-cinder-82189 Dec 16 14:40:27.235188 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-5dc10869-017a-4f36-88ef-7b070310fa8c req-d9ba9a7e-c1e3-42c2-9a40-fcac27d92951 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107263 Dec 16 14:40:27.235833 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 158/305] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:27.255282 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-21c0362e-ee51-4c24-bdae-ef4549ae63c8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:27.256727 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-21c0362e-ee51-4c24-bdae-ef4549ae63c8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:27.271397 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-21c0362e-ee51-4c24-bdae-ef4549ae63c8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.272345 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-21c0362e-ee51-4c24-bdae-ef4549ae63c8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.273776 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-21c0362e-ee51-4c24-bdae-ef4549ae63c8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.274651 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-21c0362e-ee51-4c24-bdae-ef4549ae63c8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.572587 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-21c0362e-ee51-4c24-bdae-ef4549ae63c8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:27.585531 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-21c0362e-ee51-4c24-bdae-ef4549ae63c8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.348349 Dec 16 14:40:27.586604 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 159/306] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:27 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:27.779423 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-66275546-88a3-4b8b-a7d4-45386edbe61a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:27.815283 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-66275546-88a3-4b8b-a7d4-45386edbe61a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.697932 Dec 16 14:40:27.822724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 148/307] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:27 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:28.150563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-50f7652a-2363-40d9-8b8e-e1e07ceecea6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:28.152560 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-50f7652a-2363-40d9-8b8e-e1e07ceecea6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:28.155473 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-dc940904-bc0b-4f78-828d-5b68d861b02b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:28.166515 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-dc940904-bc0b-4f78-828d-5b68d861b02b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:28.180997 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-50f7652a-2363-40d9-8b8e-e1e07ceecea6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.185565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-50f7652a-2363-40d9-8b8e-e1e07ceecea6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.186754 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-50f7652a-2363-40d9-8b8e-e1e07ceecea6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.187359 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-50f7652a-2363-40d9-8b8e-e1e07ceecea6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.223552 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dc940904-bc0b-4f78-828d-5b68d861b02b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.227692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dc940904-bc0b-4f78-828d-5b68d861b02b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.229624 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dc940904-bc0b-4f78-828d-5b68d861b02b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.242038 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dc940904-bc0b-4f78-828d-5b68d861b02b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.594095 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-50f7652a-2363-40d9-8b8e-e1e07ceecea6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.458972 Dec 16 14:40:28.601738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 149/308] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:28 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:28.623157 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5b566c9d-9dde-4aa9-a5bb-6ab462edcb71 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:28.623999 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5b566c9d-9dde-4aa9-a5bb-6ab462edcb71 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:28.634587 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b566c9d-9dde-4aa9-a5bb-6ab462edcb71 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.635033 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b566c9d-9dde-4aa9-a5bb-6ab462edcb71 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.636001 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b566c9d-9dde-4aa9-a5bb-6ab462edcb71 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.636578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b566c9d-9dde-4aa9-a5bb-6ab462edcb71 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.686285 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-dc940904-bc0b-4f78-828d-5b68d861b02b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.568112 Dec 16 14:40:28.694688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 160/309] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:28 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:28.872822 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-27acd923-6d1d-49c3-9637-ef5af4016511 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:28.874722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-27acd923-6d1d-49c3-9637-ef5af4016511 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:28.886480 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27acd923-6d1d-49c3-9637-ef5af4016511 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.887346 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27acd923-6d1d-49c3-9637-ef5af4016511 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.888505 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27acd923-6d1d-49c3-9637-ef5af4016511 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.889274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27acd923-6d1d-49c3-9637-ef5af4016511 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:29.262469 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-27acd923-6d1d-49c3-9637-ef5af4016511 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:29.273066 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-27acd923-6d1d-49c3-9637-ef5af4016511 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.422558 Dec 16 14:40:29.273949 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 161/310] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:28 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:29.370059 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5b566c9d-9dde-4aa9-a5bb-6ab462edcb71 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:29.387277 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5b566c9d-9dde-4aa9-a5bb-6ab462edcb71 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.778207 Dec 16 14:40:29.388643 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 150/311] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:28 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:29.564932 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-ec009209-9c8e-4d9e-a3a6-64388c2f6f65 req-9492040b-4029-429e-a1f1-c831ed7b9f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6662dea-31e0-4386-ab0f-3fe74bcf7ac0", "name": "network-vif-plugged", "status": "completed", "tag": "9127d9e7-040f-4d49-ba17-2bc54c53879b"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:29.586925 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:29.586925 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:40:29.609420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-ec009209-9c8e-4d9e-a3a6-64388c2f6f65 req-9492040b-4029-429e-a1f1-c831ed7b9f36 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:29.611985 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-ec009209-9c8e-4d9e-a3a6-64388c2f6f65 req-9492040b-4029-429e-a1f1-c831ed7b9f36 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:29.624336 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f0bbd5c6-6397-4c2c-947e-8c3ea53d0ffb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:29.625625 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f0bbd5c6-6397-4c2c-947e-8c3ea53d0ffb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:29.639212 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0bbd5c6-6397-4c2c-947e-8c3ea53d0ffb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:29.640044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0bbd5c6-6397-4c2c-947e-8c3ea53d0ffb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:29.641128 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0bbd5c6-6397-4c2c-947e-8c3ea53d0ffb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:29.641764 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0bbd5c6-6397-4c2c-947e-8c3ea53d0ffb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:29.656779 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-ec009209-9c8e-4d9e-a3a6-64388c2f6f65 req-9492040b-4029-429e-a1f1-c831ed7b9f36 service nova] Creating event network-vif-plugged:9127d9e7-040f-4d49-ba17-2bc54c53879b for instance d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 on hv-cinder-82189 Dec 16 14:40:29.665742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-ec009209-9c8e-4d9e-a3a6-64388c2f6f65 req-9492040b-4029-429e-a1f1-c831ed7b9f36 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134324 Dec 16 14:40:29.667637 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 162/312] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:40:29.729930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-41dd4aae-1bc4-472e-887d-5ed1da668044 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:29.733316 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-41dd4aae-1bc4-472e-887d-5ed1da668044 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:29.764699 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41dd4aae-1bc4-472e-887d-5ed1da668044 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:29.768740 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41dd4aae-1bc4-472e-887d-5ed1da668044 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:29.770929 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41dd4aae-1bc4-472e-887d-5ed1da668044 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:29.773117 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41dd4aae-1bc4-472e-887d-5ed1da668044 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:29.872024 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f0bbd5c6-6397-4c2c-947e-8c3ea53d0ffb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.265444 Dec 16 14:40:29.875622 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 151/313] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:29 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:30.065651 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-41dd4aae-1bc4-472e-887d-5ed1da668044 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.365555 Dec 16 14:40:30.074118 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 163/314] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:29 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:40:30.331163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cf3ec6a4-876d-48c3-ac4d-71425d8817ca tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:30.334437 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cf3ec6a4-876d-48c3-ac4d-71425d8817ca tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:30.394249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf3ec6a4-876d-48c3-ac4d-71425d8817ca tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.395348 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf3ec6a4-876d-48c3-ac4d-71425d8817ca tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:30.396892 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf3ec6a4-876d-48c3-ac4d-71425d8817ca tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.397668 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf3ec6a4-876d-48c3-ac4d-71425d8817ca tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:30.439256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-869b3b53-28d5-4711-8020-f37c32d97b99 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:30.440186 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-869b3b53-28d5-4711-8020-f37c32d97b99 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:30.469281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-869b3b53-28d5-4711-8020-f37c32d97b99 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.469965 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-869b3b53-28d5-4711-8020-f37c32d97b99 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:30.472686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-869b3b53-28d5-4711-8020-f37c32d97b99 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.473440 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-869b3b53-28d5-4711-8020-f37c32d97b99 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:30.847338 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-869b3b53-28d5-4711-8020-f37c32d97b99 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:30.864083 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-869b3b53-28d5-4711-8020-f37c32d97b99 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.452903 Dec 16 14:40:30.865054 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 164/315] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:30 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:30.899114 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-691ad1e7-6f60-481d-8d76-df86980f59b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:30.902284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-691ad1e7-6f60-481d-8d76-df86980f59b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:30.912124 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-691ad1e7-6f60-481d-8d76-df86980f59b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.912862 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-691ad1e7-6f60-481d-8d76-df86980f59b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:30.913738 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-691ad1e7-6f60-481d-8d76-df86980f59b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.914267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-691ad1e7-6f60-481d-8d76-df86980f59b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:31.064588 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cf3ec6a4-876d-48c3-ac4d-71425d8817ca tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:31.084296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cf3ec6a4-876d-48c3-ac4d-71425d8817ca tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.795191 Dec 16 14:40:31.086049 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 152/316] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:30 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:31.111311 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a3f98f8c-e157-4354-acf9-1f20756b005e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:31.113428 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a3f98f8c-e157-4354-acf9-1f20756b005e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:31.129600 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a3f98f8c-e157-4354-acf9-1f20756b005e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:31.130573 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a3f98f8c-e157-4354-acf9-1f20756b005e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:31.132478 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a3f98f8c-e157-4354-acf9-1f20756b005e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:31.134147 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a3f98f8c-e157-4354-acf9-1f20756b005e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:31.199170 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-691ad1e7-6f60-481d-8d76-df86980f59b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.312887 Dec 16 14:40:31.200229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 165/317] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:30 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:31.382628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a3f98f8c-e157-4354-acf9-1f20756b005e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.291693 Dec 16 14:40:31.383978 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 153/318] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:31 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:31.910671 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b301f52d-f5ff-41c7-98ac-e006999c3e64 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:31.912044 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b301f52d-f5ff-41c7-98ac-e006999c3e64 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:31.928643 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b301f52d-f5ff-41c7-98ac-e006999c3e64 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:31.929603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b301f52d-f5ff-41c7-98ac-e006999c3e64 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:31.931168 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b301f52d-f5ff-41c7-98ac-e006999c3e64 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:31.931985 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b301f52d-f5ff-41c7-98ac-e006999c3e64 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.133925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a731bd96-10e8-4629-b469-fc7573f1bb5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:32.135200 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a731bd96-10e8-4629-b469-fc7573f1bb5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:32.152375 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a731bd96-10e8-4629-b469-fc7573f1bb5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:32.152736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a731bd96-10e8-4629-b469-fc7573f1bb5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.154714 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a731bd96-10e8-4629-b469-fc7573f1bb5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:32.156273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a731bd96-10e8-4629-b469-fc7573f1bb5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.597831 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b301f52d-f5ff-41c7-98ac-e006999c3e64 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:32.613973 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b301f52d-f5ff-41c7-98ac-e006999c3e64 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.726846 Dec 16 14:40:32.615171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 166/319] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:31 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:32.636316 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0a636c4e-a95b-4782-a1c9-29c3152342ba tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:32.638558 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0a636c4e-a95b-4782-a1c9-29c3152342ba tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:32.654495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0a636c4e-a95b-4782-a1c9-29c3152342ba tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:32.655309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0a636c4e-a95b-4782-a1c9-29c3152342ba tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.658599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0a636c4e-a95b-4782-a1c9-29c3152342ba tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:32.659998 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0a636c4e-a95b-4782-a1c9-29c3152342ba tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.715149 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a731bd96-10e8-4629-b469-fc7573f1bb5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:32.728762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a731bd96-10e8-4629-b469-fc7573f1bb5f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1321 microversion: 2.1 time: 0.617632 Dec 16 14:40:32.731468 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 154/320] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:32 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:32.754500 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4ad57660-2eb3-413a-a78f-5b15d809e967 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:32.757262 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4ad57660-2eb3-413a-a78f-5b15d809e967 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:32.773274 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ad57660-2eb3-413a-a78f-5b15d809e967 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:32.773926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ad57660-2eb3-413a-a78f-5b15d809e967 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.775605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ad57660-2eb3-413a-a78f-5b15d809e967 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:32.776335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ad57660-2eb3-413a-a78f-5b15d809e967 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.897057 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0a636c4e-a95b-4782-a1c9-29c3152342ba tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 28592 microversion: 2.20 time: 0.279692 Dec 16 14:40:32.898808 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 167/321] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:32 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 28592 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:32.992639 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4ad57660-2eb3-413a-a78f-5b15d809e967 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28660 microversion: 2.1 time: 0.258027 Dec 16 14:40:32.998188 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 155/322] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:32 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28660 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:33.660812 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a12a4321-a44c-40b1-b75d-353308b93a66 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:33.662143 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a12a4321-a44c-40b1-b75d-353308b93a66 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:33.676910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a12a4321-a44c-40b1-b75d-353308b93a66 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:33.677694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a12a4321-a44c-40b1-b75d-353308b93a66 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:33.679273 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a12a4321-a44c-40b1-b75d-353308b93a66 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:33.680011 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a12a4321-a44c-40b1-b75d-353308b93a66 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:33.772932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ea5c11a8-658d-4e7b-85b5-54346175ba8e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:33.774314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ea5c11a8-658d-4e7b-85b5-54346175ba8e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:33.790618 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea5c11a8-658d-4e7b-85b5-54346175ba8e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:33.791777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea5c11a8-658d-4e7b-85b5-54346175ba8e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:33.793579 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea5c11a8-658d-4e7b-85b5-54346175ba8e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:33.794402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea5c11a8-658d-4e7b-85b5-54346175ba8e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.165260 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a12a4321-a44c-40b1-b75d-353308b93a66 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:34.186158 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a12a4321-a44c-40b1-b75d-353308b93a66 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.544011 Dec 16 14:40:34.187976 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 168/323] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:33 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:34.216397 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1b634564-cc17-4daf-9908-9368de3a2177 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:34.218859 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1b634564-cc17-4daf-9908-9368de3a2177 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:34.240622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1b634564-cc17-4daf-9908-9368de3a2177 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.241723 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1b634564-cc17-4daf-9908-9368de3a2177 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.244740 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1b634564-cc17-4daf-9908-9368de3a2177 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.256011 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1b634564-cc17-4daf-9908-9368de3a2177 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.284412 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ea5c11a8-658d-4e7b-85b5-54346175ba8e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:34.302531 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ea5c11a8-658d-4e7b-85b5-54346175ba8e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1516 microversion: 2.1 time: 0.547647 Dec 16 14:40:34.305034 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 156/324] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:33 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1516 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:34.340101 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b68da4a4-5025-4372-bf8c-a3443d80a149 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:34.341528 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b68da4a4-5025-4372-bf8c-a3443d80a149 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:34.356348 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b68da4a4-5025-4372-bf8c-a3443d80a149 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.357973 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b68da4a4-5025-4372-bf8c-a3443d80a149 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.361526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b68da4a4-5025-4372-bf8c-a3443d80a149 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.362843 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b68da4a4-5025-4372-bf8c-a3443d80a149 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.527187 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1b634564-cc17-4daf-9908-9368de3a2177 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 31006 microversion: 2.20 time: 0.334801 Dec 16 14:40:34.528953 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 169/325] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:34 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 31006 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:34.561278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-248ee2f5-bdbe-432b-9af3-6159a6d44c49 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:34.563898 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-248ee2f5-bdbe-432b-9af3-6159a6d44c49 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:34.582723 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-248ee2f5-bdbe-432b-9af3-6159a6d44c49 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.583559 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-248ee2f5-bdbe-432b-9af3-6159a6d44c49 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.585004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-248ee2f5-bdbe-432b-9af3-6159a6d44c49 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.585777 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-248ee2f5-bdbe-432b-9af3-6159a6d44c49 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.672366 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b68da4a4-5025-4372-bf8c-a3443d80a149 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 28692 microversion: 2.1 time: 0.362606 Dec 16 14:40:34.674238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 157/326] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:34 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 28692 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:34.714732 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-248ee2f5-bdbe-432b-9af3-6159a6d44c49 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lazy-loading 'flavor' on Instance uuid d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:40:34.941271 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-248ee2f5-bdbe-432b-9af3-6159a6d44c49 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "POST /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0/action" status: 200 len: 32 microversion: 2.1 time: 0.408637 Dec 16 14:40:34.942171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 170/327] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:34 2021] POST /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0/action => generated 32 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:40:34.962510 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8d62b964-1c90-4f6a-a768-0a5f9c122f19 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:34.963713 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8d62b964-1c90-4f6a-a768-0a5f9c122f19 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:34.976707 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d62b964-1c90-4f6a-a768-0a5f9c122f19 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.977277 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d62b964-1c90-4f6a-a768-0a5f9c122f19 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.978211 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d62b964-1c90-4f6a-a768-0a5f9c122f19 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.978751 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d62b964-1c90-4f6a-a768-0a5f9c122f19 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:35.236242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-25ad031c-057c-42c0-82ef-f50acdc2dab1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:35.237713 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-25ad031c-057c-42c0-82ef-f50acdc2dab1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:35.254836 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-25ad031c-057c-42c0-82ef-f50acdc2dab1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:35.256132 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-25ad031c-057c-42c0-82ef-f50acdc2dab1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:35.257255 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-25ad031c-057c-42c0-82ef-f50acdc2dab1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:35.257785 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-25ad031c-057c-42c0-82ef-f50acdc2dab1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:35.480444 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8d62b964-1c90-4f6a-a768-0a5f9c122f19 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:35.491907 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8d62b964-1c90-4f6a-a768-0a5f9c122f19 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.543375 Dec 16 14:40:35.502200 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 158/328] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:34 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:35.561785 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-310a11a3-e552-4230-945e-c433c2c64490 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:35.563897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-310a11a3-e552-4230-945e-c433c2c64490 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:35.579332 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-310a11a3-e552-4230-945e-c433c2c64490 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:35.580212 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-310a11a3-e552-4230-945e-c433c2c64490 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:35.583004 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-310a11a3-e552-4230-945e-c433c2c64490 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:35.584253 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-310a11a3-e552-4230-945e-c433c2c64490 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:35.664654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-25ad031c-057c-42c0-82ef-f50acdc2dab1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:35.681144 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-25ad031c-057c-42c0-82ef-f50acdc2dab1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.468353 Dec 16 14:40:35.682525 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 171/329] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:35 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:35.724890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-040fe1b7-359b-4ea2-94e1-ad470dfb1b8e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:35.728331 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-040fe1b7-359b-4ea2-94e1-ad470dfb1b8e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:35.760420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-040fe1b7-359b-4ea2-94e1-ad470dfb1b8e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:35.761287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-040fe1b7-359b-4ea2-94e1-ad470dfb1b8e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:35.763556 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-040fe1b7-359b-4ea2-94e1-ad470dfb1b8e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:35.764231 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-040fe1b7-359b-4ea2-94e1-ad470dfb1b8e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:35.860068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-310a11a3-e552-4230-945e-c433c2c64490 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 32518 microversion: 2.20 time: 0.318104 Dec 16 14:40:35.862997 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 159/330] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:35 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 32518 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:36.031572 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-040fe1b7-359b-4ea2-94e1-ad470dfb1b8e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 30552 microversion: 2.1 time: 0.346690 Dec 16 14:40:36.041675 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 172/331] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:35 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 30552 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:36.558364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c5c44ed7-237d-4437-a53a-bc130875dfdb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:36.562916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c5c44ed7-237d-4437-a53a-bc130875dfdb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:36.597707 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c5c44ed7-237d-4437-a53a-bc130875dfdb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.598577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c5c44ed7-237d-4437-a53a-bc130875dfdb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:36.606364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c5c44ed7-237d-4437-a53a-bc130875dfdb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.614808 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c5c44ed7-237d-4437-a53a-bc130875dfdb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:36.718523 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c47cd08a-aa53-439f-a656-ecb698be4b40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:36.719345 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c47cd08a-aa53-439f-a656-ecb698be4b40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:36.729206 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c47cd08a-aa53-439f-a656-ecb698be4b40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.730012 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c47cd08a-aa53-439f-a656-ecb698be4b40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:36.731060 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c47cd08a-aa53-439f-a656-ecb698be4b40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.731726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c47cd08a-aa53-439f-a656-ecb698be4b40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:37.111771 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c5c44ed7-237d-4437-a53a-bc130875dfdb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:37.133661 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c5c44ed7-237d-4437-a53a-bc130875dfdb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.616802 Dec 16 14:40:37.134435 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 160/332] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:36 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:37.148630 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c47cd08a-aa53-439f-a656-ecb698be4b40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:37.159279 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8b76b008-c190-45fc-b74c-979b503b2e59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:37.161303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8b76b008-c190-45fc-b74c-979b503b2e59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:37.167293 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c47cd08a-aa53-439f-a656-ecb698be4b40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.462187 Dec 16 14:40:37.169221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 173/333] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:36 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:37.194583 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-da0c3ff7-4bae-4421-911c-ebd9a6a66256 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:37.197369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-da0c3ff7-4bae-4421-911c-ebd9a6a66256 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:37.205033 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b76b008-c190-45fc-b74c-979b503b2e59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:37.211564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b76b008-c190-45fc-b74c-979b503b2e59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:37.213402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-da0c3ff7-4bae-4421-911c-ebd9a6a66256 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:37.213590 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b76b008-c190-45fc-b74c-979b503b2e59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:37.214383 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b76b008-c190-45fc-b74c-979b503b2e59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:37.214571 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-da0c3ff7-4bae-4421-911c-ebd9a6a66256 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:37.216349 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-da0c3ff7-4bae-4421-911c-ebd9a6a66256 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:37.217591 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-da0c3ff7-4bae-4421-911c-ebd9a6a66256 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:37.461202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-da0c3ff7-4bae-4421-911c-ebd9a6a66256 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 32674 microversion: 2.1 time: 0.289093 Dec 16 14:40:37.466057 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 174/334] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:37 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 32674 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:37.495452 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8b76b008-c190-45fc-b74c-979b503b2e59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 33603 microversion: 2.20 time: 0.357530 Dec 16 14:40:37.496507 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 161/335] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:37 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 33603 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:37.557923 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-582d5c50-66c0-4d98-a5a1-f5f0135f6bc6 req-a66bc854-2b73-455e-8ece-8291738ca234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc", "name": "network-vif-plugged", "status": "completed", "tag": "6978c6aa-5ee8-4ed8-9bd4-c826607ba4ff"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:37.574473 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:37.574473 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:40:37.591083 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-582d5c50-66c0-4d98-a5a1-f5f0135f6bc6 req-a66bc854-2b73-455e-8ece-8291738ca234 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:37.591906 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-582d5c50-66c0-4d98-a5a1-f5f0135f6bc6 req-a66bc854-2b73-455e-8ece-8291738ca234 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:37.627407 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-582d5c50-66c0-4d98-a5a1-f5f0135f6bc6 req-a66bc854-2b73-455e-8ece-8291738ca234 service nova] Creating event network-vif-plugged:6978c6aa-5ee8-4ed8-9bd4-c826607ba4ff for instance b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc on hv-cinder-82189 Dec 16 14:40:37.636618 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-582d5c50-66c0-4d98-a5a1-f5f0135f6bc6 req-a66bc854-2b73-455e-8ece-8291738ca234 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097899 Dec 16 14:40:37.638039 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 175/336] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:38.207320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-aa6e8632-637f-4c30-8484-191a06db9894 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:38.208261 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-aa6e8632-637f-4c30-8484-191a06db9894 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:38.245561 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-aa6e8632-637f-4c30-8484-191a06db9894 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.246554 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b4d0ef76-a39e-4c1b-83cf-1272d34d4b22 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:38.247772 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-aa6e8632-637f-4c30-8484-191a06db9894 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.248362 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b4d0ef76-a39e-4c1b-83cf-1272d34d4b22 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:38.250141 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-aa6e8632-637f-4c30-8484-191a06db9894 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.251175 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-aa6e8632-637f-4c30-8484-191a06db9894 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.274744 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b4d0ef76-a39e-4c1b-83cf-1272d34d4b22 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.277857 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b4d0ef76-a39e-4c1b-83cf-1272d34d4b22 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.284783 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b4d0ef76-a39e-4c1b-83cf-1272d34d4b22 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.285742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b4d0ef76-a39e-4c1b-83cf-1272d34d4b22 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.657558 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-aa6e8632-637f-4c30-8484-191a06db9894 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:38.674141 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-aa6e8632-637f-4c30-8484-191a06db9894 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.511722 Dec 16 14:40:38.679590 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 162/337] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:38 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:38.706761 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-98b74a82-81fe-47e2-ae1b-e24fbc91ab10 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:38.708775 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-98b74a82-81fe-47e2-ae1b-e24fbc91ab10 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:38.725793 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-98b74a82-81fe-47e2-ae1b-e24fbc91ab10 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.725793 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-98b74a82-81fe-47e2-ae1b-e24fbc91ab10 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.729577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-98b74a82-81fe-47e2-ae1b-e24fbc91ab10 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.730335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-98b74a82-81fe-47e2-ae1b-e24fbc91ab10 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.742632 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b4d0ef76-a39e-4c1b-83cf-1272d34d4b22 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:38.780652 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b4d0ef76-a39e-4c1b-83cf-1272d34d4b22 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.579205 Dec 16 14:40:38.783402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 176/338] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:38 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:38.826322 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6aa28516-9375-47ef-8f26-fb8b337f7cfc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:38.828587 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6aa28516-9375-47ef-8f26-fb8b337f7cfc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:38.845067 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6aa28516-9375-47ef-8f26-fb8b337f7cfc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.846236 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6aa28516-9375-47ef-8f26-fb8b337f7cfc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.847817 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6aa28516-9375-47ef-8f26-fb8b337f7cfc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.849298 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6aa28516-9375-47ef-8f26-fb8b337f7cfc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:41.629175 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6aa28516-9375-47ef-8f26-fb8b337f7cfc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 37351 microversion: 2.20 time: 2.839536 Dec 16 14:40:41.630797 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 177/339] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:38 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 37351 bytes in 2847 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:41.658336 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-98b74a82-81fe-47e2-ae1b-e24fbc91ab10 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 36261 microversion: 2.1 time: 2.974396 Dec 16 14:40:41.665864 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 163/340] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:38 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 36261 bytes in 2981 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:41.676506 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-30b306ef-2f87-4601-a438-aa8facf15815 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:41.684168 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-30b306ef-2f87-4601-a438-aa8facf15815 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:41.715725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-30b306ef-2f87-4601-a438-aa8facf15815 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:41.719977 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8afe43d0-5c56-4cc1-901f-1aeffa36588f tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:41.721644 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-30b306ef-2f87-4601-a438-aa8facf15815 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:41.722609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8afe43d0-5c56-4cc1-901f-1aeffa36588f tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:41.727747 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-30b306ef-2f87-4601-a438-aa8facf15815 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:41.728757 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-30b306ef-2f87-4601-a438-aa8facf15815 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:41.766442 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8afe43d0-5c56-4cc1-901f-1aeffa36588f tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:41.767590 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8afe43d0-5c56-4cc1-901f-1aeffa36588f tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:41.774785 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8afe43d0-5c56-4cc1-901f-1aeffa36588f tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:41.776286 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8afe43d0-5c56-4cc1-901f-1aeffa36588f tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.356971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8afe43d0-5c56-4cc1-901f-1aeffa36588f tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:42.380926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8afe43d0-5c56-4cc1-901f-1aeffa36588f tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.714847 Dec 16 14:40:42.384116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 164/341] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:41 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:42.647772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-30b306ef-2f87-4601-a438-aa8facf15815 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:42.668536 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-30b306ef-2f87-4601-a438-aa8facf15815 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 1.032962 Dec 16 14:40:42.668536 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 178/342] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:41 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:42.675720 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-89518a21-7f49-4d24-b09e-4cee63591a76 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:42.678313 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-89518a21-7f49-4d24-b09e-4cee63591a76 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:42.692040 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-59cfe0a7-77ad-4e3d-a184-36a344fa16ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:42.693648 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-59cfe0a7-77ad-4e3d-a184-36a344fa16ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:42.702700 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-89518a21-7f49-4d24-b09e-4cee63591a76 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.704073 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-89518a21-7f49-4d24-b09e-4cee63591a76 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.706646 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-89518a21-7f49-4d24-b09e-4cee63591a76 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.707888 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-89518a21-7f49-4d24-b09e-4cee63591a76 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.715366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-59cfe0a7-77ad-4e3d-a184-36a344fa16ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.716478 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-59cfe0a7-77ad-4e3d-a184-36a344fa16ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.718123 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-59cfe0a7-77ad-4e3d-a184-36a344fa16ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.719682 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-59cfe0a7-77ad-4e3d-a184-36a344fa16ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:46.823218 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-89518a21-7f49-4d24-b09e-4cee63591a76 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 38070 microversion: 2.20 time: 4.181648 Dec 16 14:40:46.824474 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 165/343] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:42 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 38070 bytes in 4184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:46.853582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-022e82de-8374-4c5f-82e5-6db998652e7e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:46.858538 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-022e82de-8374-4c5f-82e5-6db998652e7e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:46.871516 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-59cfe0a7-77ad-4e3d-a184-36a344fa16ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 38110 microversion: 2.1 time: 4.199407 Dec 16 14:40:46.881533 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 179/344] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:42 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 38110 bytes in 4208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:46.881803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-022e82de-8374-4c5f-82e5-6db998652e7e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.881803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-022e82de-8374-4c5f-82e5-6db998652e7e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:46.881803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-022e82de-8374-4c5f-82e5-6db998652e7e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.881803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-022e82de-8374-4c5f-82e5-6db998652e7e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:46.904978 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-87adda02-02dc-4816-a9ae-547be138eb84 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:46.914423 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-87adda02-02dc-4816-a9ae-547be138eb84 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:46.930895 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-87adda02-02dc-4816-a9ae-547be138eb84 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.931690 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-87adda02-02dc-4816-a9ae-547be138eb84 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:46.932764 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-87adda02-02dc-4816-a9ae-547be138eb84 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.933425 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-87adda02-02dc-4816-a9ae-547be138eb84 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.346027 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-022e82de-8374-4c5f-82e5-6db998652e7e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:47.368296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-022e82de-8374-4c5f-82e5-6db998652e7e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.542216 Dec 16 14:40:47.368955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 166/345] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:46 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:47.627806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-87adda02-02dc-4816-a9ae-547be138eb84 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:47.641875 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-87adda02-02dc-4816-a9ae-547be138eb84 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.755587 Dec 16 14:40:47.642467 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 180/346] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:46 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:47.854662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3011e6c0-f019-43f8-b312-6d36822d64fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:47.857661 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3011e6c0-f019-43f8-b312-6d36822d64fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:47.881192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3011e6c0-f019-43f8-b312-6d36822d64fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.900070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3011e6c0-f019-43f8-b312-6d36822d64fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.902354 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3011e6c0-f019-43f8-b312-6d36822d64fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.903703 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3011e6c0-f019-43f8-b312-6d36822d64fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.918340 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-447089b0-b8c7-40cb-96fd-2dd0b40b1747 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:47.932070 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-447089b0-b8c7-40cb-96fd-2dd0b40b1747 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:47.958526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-447089b0-b8c7-40cb-96fd-2dd0b40b1747 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.959224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-447089b0-b8c7-40cb-96fd-2dd0b40b1747 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.960187 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-447089b0-b8c7-40cb-96fd-2dd0b40b1747 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.960758 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-447089b0-b8c7-40cb-96fd-2dd0b40b1747 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.276244 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-447089b0-b8c7-40cb-96fd-2dd0b40b1747 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 38110 microversion: 2.1 time: 0.389026 Dec 16 14:40:48.278725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 181/347] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:47 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 38110 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:40:48.303072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3011e6c0-f019-43f8-b312-6d36822d64fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 38070 microversion: 2.20 time: 0.469603 Dec 16 14:40:48.304239 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 167/348] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:47 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 38070 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:48.403839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f94ccd9b-1298-40f5-a995-1364cee8e5d4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:48.404680 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f94ccd9b-1298-40f5-a995-1364cee8e5d4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:48.424151 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f94ccd9b-1298-40f5-a995-1364cee8e5d4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.424783 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f94ccd9b-1298-40f5-a995-1364cee8e5d4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.428687 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f94ccd9b-1298-40f5-a995-1364cee8e5d4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.429364 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f94ccd9b-1298-40f5-a995-1364cee8e5d4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.684849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e617541e-eb13-4fa6-aaea-5c0737db278e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:48.684849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e617541e-eb13-4fa6-aaea-5c0737db278e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:48.704107 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e617541e-eb13-4fa6-aaea-5c0737db278e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.704671 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e617541e-eb13-4fa6-aaea-5c0737db278e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.713979 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e617541e-eb13-4fa6-aaea-5c0737db278e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.719953 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e617541e-eb13-4fa6-aaea-5c0737db278e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.947062 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f94ccd9b-1298-40f5-a995-1364cee8e5d4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:48.965718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f94ccd9b-1298-40f5-a995-1364cee8e5d4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.575679 Dec 16 14:40:48.968481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 182/349] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:48 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:49.227977 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e617541e-eb13-4fa6-aaea-5c0737db278e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:49.248503 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e617541e-eb13-4fa6-aaea-5c0737db278e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.585469 Dec 16 14:40:49.251358 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 168/350] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:48 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:49.316173 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-808d04e1-57d3-447a-846a-b14b87de5b05 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:49.317889 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-808d04e1-57d3-447a-846a-b14b87de5b05 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:49.334362 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-808d04e1-57d3-447a-846a-b14b87de5b05 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.335527 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-808d04e1-57d3-447a-846a-b14b87de5b05 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.339629 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-293656b5-49c9-4299-913d-49b1ec85dbb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:49.341955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-293656b5-49c9-4299-913d-49b1ec85dbb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:49.345825 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-808d04e1-57d3-447a-846a-b14b87de5b05 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.354671 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-808d04e1-57d3-447a-846a-b14b87de5b05 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.357476 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-293656b5-49c9-4299-913d-49b1ec85dbb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.358190 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-293656b5-49c9-4299-913d-49b1ec85dbb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.359839 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-293656b5-49c9-4299-913d-49b1ec85dbb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.360624 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-293656b5-49c9-4299-913d-49b1ec85dbb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.605471 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-808d04e1-57d3-447a-846a-b14b87de5b05 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 200 len: 38238 microversion: 2.1 time: 0.315870 Dec 16 14:40:49.608304 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 183/351] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:49 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 38238 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:40:49.642745 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-293656b5-49c9-4299-913d-49b1ec85dbb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 200 len: 38211 microversion: 2.20 time: 0.326247 Dec 16 14:40:49.645094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 169/352] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:49 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 38211 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:49.669668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1292431d-eb66-4dd3-8c60-06f8abadf14d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:49.672078 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1292431d-eb66-4dd3-8c60-06f8abadf14d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:49.707382 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8ba4c4a6-681b-4ce6-a1f9-083104986fe6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:49.711966 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8ba4c4a6-681b-4ce6-a1f9-083104986fe6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:49.716524 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1292431d-eb66-4dd3-8c60-06f8abadf14d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.719986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1292431d-eb66-4dd3-8c60-06f8abadf14d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.721615 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1292431d-eb66-4dd3-8c60-06f8abadf14d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.725843 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1292431d-eb66-4dd3-8c60-06f8abadf14d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.750601 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8ba4c4a6-681b-4ce6-a1f9-083104986fe6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.756297 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8ba4c4a6-681b-4ce6-a1f9-083104986fe6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.763303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8ba4c4a6-681b-4ce6-a1f9-083104986fe6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.764861 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8ba4c4a6-681b-4ce6-a1f9-083104986fe6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.100794 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1292431d-eb66-4dd3-8c60-06f8abadf14d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/ips" status: 200 len: 146 microversion: 2.1 time: 0.485176 Dec 16 14:40:50.115429 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8ba4c4a6-681b-4ce6-a1f9-083104986fe6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/ips" status: 200 len: 151 microversion: 2.20 time: 0.458395 Dec 16 14:40:50.116496 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 184/353] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Dec 16 14:40:49 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/ips => generated 146 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:50.126982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 170/354] 10.222.0.67 () {60 vars in 1288 bytes} [Thu Dec 16 14:40:49 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/ips => generated 151 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:40:50.183588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ca4873bb-99b0-4c17-bcf0-fba03a833773 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:50.184975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ca4873bb-99b0-4c17-bcf0-fba03a833773 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:50.219230 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ca4873bb-99b0-4c17-bcf0-fba03a833773 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.223202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ca4873bb-99b0-4c17-bcf0-fba03a833773 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.232620 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ca4873bb-99b0-4c17-bcf0-fba03a833773 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.234897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ca4873bb-99b0-4c17-bcf0-fba03a833773 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.311030 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fec5c107-80bd-499f-8f66-6bb4d8f7a978 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:50.312495 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fec5c107-80bd-499f-8f66-6bb4d8f7a978 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:50.351883 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fec5c107-80bd-499f-8f66-6bb4d8f7a978 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.353409 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fec5c107-80bd-499f-8f66-6bb4d8f7a978 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.358094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fec5c107-80bd-499f-8f66-6bb4d8f7a978 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.360276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fec5c107-80bd-499f-8f66-6bb4d8f7a978 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.800463 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ca4873bb-99b0-4c17-bcf0-fba03a833773 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:50.818432 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ca4873bb-99b0-4c17-bcf0-fba03a833773 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1497 microversion: 2.1 time: 0.699358 Dec 16 14:40:50.819445 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 185/355] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:50 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1497 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:51.608960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fec5c107-80bd-499f-8f66-6bb4d8f7a978 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:51.630816 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fec5c107-80bd-499f-8f66-6bb4d8f7a978 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 1.360704 Dec 16 14:40:51.635987 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 171/356] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:50 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:52.677716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1bca85ad-d3ff-4ab5-8653-f4ac983dba93 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:52.678628 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1bca85ad-d3ff-4ab5-8653-f4ac983dba93 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:52.710990 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1bca85ad-d3ff-4ab5-8653-f4ac983dba93 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.711473 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1bca85ad-d3ff-4ab5-8653-f4ac983dba93 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:52.713657 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1bca85ad-d3ff-4ab5-8653-f4ac983dba93 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.715698 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1bca85ad-d3ff-4ab5-8653-f4ac983dba93 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:53.206126 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-1bca85ad-d3ff-4ab5-8653-f4ac983dba93 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:53.241945 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1bca85ad-d3ff-4ab5-8653-f4ac983dba93 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.578159 Dec 16 14:40:53.252718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 186/357] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:52 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:53.286563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a279bb0c-2d70-4353-822a-d570eed7c74c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:53.287459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a279bb0c-2d70-4353-822a-d570eed7c74c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:53.390241 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a279bb0c-2d70-4353-822a-d570eed7c74c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:53.392368 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a279bb0c-2d70-4353-822a-d570eed7c74c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:53.399585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a279bb0c-2d70-4353-822a-d570eed7c74c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:53.401025 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a279bb0c-2d70-4353-822a-d570eed7c74c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:53.587980 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a279bb0c-2d70-4353-822a-d570eed7c74c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:40:54.054539 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2c700a6d-0070-4398-9e58-194449180ce4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2bdc85b-7b6e-433d-b2aa-8f4ee811896e"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:54.057320 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2c700a6d-0070-4398-9e58-194449180ce4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:54.066309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a279bb0c-2d70-4353-822a-d570eed7c74c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 204 len: 0 microversion: 2.1 time: 0.823163 Dec 16 14:40:54.068538 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2c700a6d-0070-4398-9e58-194449180ce4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.069341 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2c700a6d-0070-4398-9e58-194449180ce4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:54.069955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 172/358] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:40:53 2021] DELETE /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 0 bytes in 830 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:40:54.070913 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2c700a6d-0070-4398-9e58-194449180ce4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.071684 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2c700a6d-0070-4398-9e58-194449180ce4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:54.100282 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-08e6063c-2be7-4fef-9406-88969b1569f7 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:54.100982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-08e6063c-2be7-4fef-9406-88969b1569f7 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:54.126291 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-08e6063c-2be7-4fef-9406-88969b1569f7 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.126728 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-08e6063c-2be7-4fef-9406-88969b1569f7 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:54.127511 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-08e6063c-2be7-4fef-9406-88969b1569f7 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.127944 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-08e6063c-2be7-4fef-9406-88969b1569f7 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.202172 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2c700a6d-0070-4398-9e58-194449180ce4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.158492 Dec 16 14:40:55.205145 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 187/359] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:40:54 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/os-volume_attachments => generated 194 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:55.254596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7620c43b-0b41-47a9-b30c-e16b7ec96fb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:55.256004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7620c43b-0b41-47a9-b30c-e16b7ec96fb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:55.272174 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7620c43b-0b41-47a9-b30c-e16b7ec96fb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.273425 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7620c43b-0b41-47a9-b30c-e16b7ec96fb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.274687 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7620c43b-0b41-47a9-b30c-e16b7ec96fb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.275227 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7620c43b-0b41-47a9-b30c-e16b7ec96fb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.358096 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-08e6063c-2be7-4fef-9406-88969b1569f7 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:55.396342 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-08e6063c-2be7-4fef-9406-88969b1569f7 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1503 microversion: 2.1 time: 1.319155 Dec 16 14:40:55.402046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 173/360] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:54 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1503 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:55.452091 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4c8dad79-0862-4bc3-b03e-ebea5ef05278 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:55.452975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4c8dad79-0862-4bc3-b03e-ebea5ef05278 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:55.474843 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4c8dad79-0862-4bc3-b03e-ebea5ef05278 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.477808 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4c8dad79-0862-4bc3-b03e-ebea5ef05278 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.487765 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4c8dad79-0862-4bc3-b03e-ebea5ef05278 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.493981 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4c8dad79-0862-4bc3-b03e-ebea5ef05278 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.711447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7620c43b-0b41-47a9-b30c-e16b7ec96fb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:55.714022 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.objects.instance [None req-4c8dad79-0862-4bc3-b03e-ebea5ef05278 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lazy-loading 'flavor' on Instance uuid 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 {{(pid=96669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:40:55.725100 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7620c43b-0b41-47a9-b30c-e16b7ec96fb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.517818 Dec 16 14:40:55.737308 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 188/361] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:55 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:56.474358 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4c8dad79-0862-4bc3-b03e-ebea5ef05278 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 202 len: 0 microversion: 2.20 time: 1.069654 Dec 16 14:40:56.487501 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4b54e408-0213-4f45-86cf-91243143d8b1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:56.489065 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4b54e408-0213-4f45-86cf-91243143d8b1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:56.490913 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 174/362] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:55 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:40:56.540411 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:56.541912 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:56.549479 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4b54e408-0213-4f45-86cf-91243143d8b1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:56.556379 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4b54e408-0213-4f45-86cf-91243143d8b1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:56.568072 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4b54e408-0213-4f45-86cf-91243143d8b1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:56.568914 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4b54e408-0213-4f45-86cf-91243143d8b1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:56.594770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:56.596043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:56.603618 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:56.606220 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:57.674283 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:57.736002 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:57.766605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:57.775691 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3f831354-62cc-4a6c-9c83-afd47e0a9138 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 1.280669 Dec 16 14:40:57.777054 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 175/363] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:40:56 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:40:57.860991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f59ada6c-8fba-4936-be88-a0831c285804 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:57.862544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f59ada6c-8fba-4936-be88-a0831c285804 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:57.898987 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f59ada6c-8fba-4936-be88-a0831c285804 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:57.900777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f59ada6c-8fba-4936-be88-a0831c285804 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:57.903540 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f59ada6c-8fba-4936-be88-a0831c285804 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:57.908196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f59ada6c-8fba-4936-be88-a0831c285804 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:59.544074 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f59ada6c-8fba-4936-be88-a0831c285804 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:40:59.601340 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f59ada6c-8fba-4936-be88-a0831c285804 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 1.801893 Dec 16 14:40:59.602635 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 176/364] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:57 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:59.713264 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:59.713880 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:40:59.768998 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:59.796468 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:59.800600 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:59.804630 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:00.062158 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4b54e408-0213-4f45-86cf-91243143d8b1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:00.140907 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4b54e408-0213-4f45-86cf-91243143d8b1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1503 microversion: 2.1 time: 3.713342 Dec 16 14:41:00.159209 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 189/365] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:56 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1503 bytes in 3733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:00.421545 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-2513ebb0-ec73-42ff-98bf-2f4c80a42d21 req-cf8388bc-899f-498f-8354-00fb31728477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc", "name": "network-vif-unplugged", "status": "completed", "tag": "6978c6aa-5ee8-4ed8-9bd4-c826607ba4ff"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:00.484757 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:00.484757 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:41:00.540417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-2513ebb0-ec73-42ff-98bf-2f4c80a42d21 req-cf8388bc-899f-498f-8354-00fb31728477 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:00.543139 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-2513ebb0-ec73-42ff-98bf-2f4c80a42d21 req-cf8388bc-899f-498f-8354-00fb31728477 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:00.631358 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-2513ebb0-ec73-42ff-98bf-2f4c80a42d21 req-cf8388bc-899f-498f-8354-00fb31728477 service nova] Creating event network-vif-unplugged:6978c6aa-5ee8-4ed8-9bd4-c826607ba4ff for instance b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc on hv-cinder-82189 Dec 16 14:41:00.644798 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-2513ebb0-ec73-42ff-98bf-2f4c80a42d21 req-cf8388bc-899f-498f-8354-00fb31728477 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.270242 Dec 16 14:41:00.663764 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 190/366] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:00 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:41:00.716934 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e1448e3d-75ee-4bf0-93b7-7456864f5eb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:00.725359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e1448e3d-75ee-4bf0-93b7-7456864f5eb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:00.766395 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1448e3d-75ee-4bf0-93b7-7456864f5eb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:00.772401 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1448e3d-75ee-4bf0-93b7-7456864f5eb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:00.774461 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1448e3d-75ee-4bf0-93b7-7456864f5eb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:00.778771 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1448e3d-75ee-4bf0-93b7-7456864f5eb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:01.175494 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:01.254856 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:01.293979 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:01.299372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-85c7a5c6-73f9-4790-9670-45a11eea9bbc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 1.687028 Dec 16 14:41:01.325595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 177/367] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:40:59 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:01.411637 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ea3382c9-510a-4cfd-9839-b7629730e9c5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:01.418224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ea3382c9-510a-4cfd-9839-b7629730e9c5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:01.496337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea3382c9-510a-4cfd-9839-b7629730e9c5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:01.497339 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea3382c9-510a-4cfd-9839-b7629730e9c5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:01.500222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea3382c9-510a-4cfd-9839-b7629730e9c5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:01.517559 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea3382c9-510a-4cfd-9839-b7629730e9c5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:02.527910 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ea3382c9-510a-4cfd-9839-b7629730e9c5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:02.575073 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ea3382c9-510a-4cfd-9839-b7629730e9c5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1503 microversion: 2.1 time: 1.239041 Dec 16 14:41:02.576500 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 178/368] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:01 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1503 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:02.621844 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:02.635589 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:02.660782 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:02.662245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:02.664196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:02.665400 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:03.353851 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e1448e3d-75ee-4bf0-93b7-7456864f5eb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:03.384080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e1448e3d-75ee-4bf0-93b7-7456864f5eb1 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 2.712233 Dec 16 14:41:03.386265 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 191/369] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:00 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 2717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:03.618426 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-45b97304-fc73-431b-b924-9e8595ea2493 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:03.640510 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-45b97304-fc73-431b-b924-9e8595ea2493 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:03.687986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-45b97304-fc73-431b-b924-9e8595ea2493 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:03.688691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-45b97304-fc73-431b-b924-9e8595ea2493 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:03.690012 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-45b97304-fc73-431b-b924-9e8595ea2493 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:03.690653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-45b97304-fc73-431b-b924-9e8595ea2493 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.187186 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-45b97304-fc73-431b-b924-9e8595ea2493 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:04.202081 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-45b97304-fc73-431b-b924-9e8595ea2493 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 200 len: 1461 microversion: 2.1 time: 0.609623 Dec 16 14:41:04.202975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 192/370] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:03 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 1461 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:04.248498 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-017a08be-d71a-45a7-b01c-c468046cf448 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:04.283603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-017a08be-d71a-45a7-b01c-c468046cf448 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.284498 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-017a08be-d71a-45a7-b01c-c468046cf448 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.438156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-017a08be-d71a-45a7-b01c-c468046cf448 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Going to try to stop instance {{(pid=96670) force_stop /opt/stack/nova/nova/compute/api.py:2599}} Dec 16 14:41:04.647977 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-017a08be-d71a-45a7-b01c-c468046cf448 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 202 len: 0 microversion: 2.1 time: 0.443240 Dec 16 14:41:04.653252 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 193/371] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:41:04 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:41:04.669369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-5dc9c16f-cf74-42ff-9117-8f27b8978dd6 req-5ca461d7-d055-4316-8eed-aae611a28fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc", "name": "network-vif-deleted", "tag": "6978c6aa-5ee8-4ed8-9bd4-c826607ba4ff"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:04.679401 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:04.679401 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:41:04.693402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:04.698135 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5dc9c16f-cf74-42ff-9117-8f27b8978dd6 req-5ca461d7-d055-4316-8eed-aae611a28fb3 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.699373 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5dc9c16f-cf74-42ff-9117-8f27b8978dd6 req-5ca461d7-d055-4316-8eed-aae611a28fb3 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.775706 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-5dc9c16f-cf74-42ff-9117-8f27b8978dd6 req-5ca461d7-d055-4316-8eed-aae611a28fb3 service nova] Creating event network-vif-deleted:6978c6aa-5ee8-4ed8-9bd4-c826607ba4ff for instance b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc on hv-cinder-82189 Dec 16 14:41:04.799145 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:04.807063 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-5dc9c16f-cf74-42ff-9117-8f27b8978dd6 req-5ca461d7-d055-4316-8eed-aae611a28fb3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150854 Dec 16 14:41:04.809048 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 194/372] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:04.841664 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-68ad9b40-9f63-40f6-9812-0227c68bba5d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:04.843293 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-68ad9b40-9f63-40f6-9812-0227c68bba5d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:04.853304 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:04.857439 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-157d213b-e2c4-4066-a704-869a9f342145 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 2.277566 Dec 16 14:41:04.875987 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 179/373] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:02 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:04.897060 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b981d9ff-d2f3-42fb-a00b-ace41c0c3870 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:04.898627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b981d9ff-d2f3-42fb-a00b-ace41c0c3870 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:04.905576 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-68ad9b40-9f63-40f6-9812-0227c68bba5d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.906823 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-68ad9b40-9f63-40f6-9812-0227c68bba5d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.908193 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-68ad9b40-9f63-40f6-9812-0227c68bba5d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.912257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-68ad9b40-9f63-40f6-9812-0227c68bba5d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.927080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b981d9ff-d2f3-42fb-a00b-ace41c0c3870 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.928236 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b981d9ff-d2f3-42fb-a00b-ace41c0c3870 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.930180 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b981d9ff-d2f3-42fb-a00b-ace41c0c3870 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.931279 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b981d9ff-d2f3-42fb-a00b-ace41c0c3870 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:05.499407 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-68ad9b40-9f63-40f6-9812-0227c68bba5d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:05.514769 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-68ad9b40-9f63-40f6-9812-0227c68bba5d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.703514 Dec 16 14:41:05.517132 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 195/374] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:04 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:05.542525 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fcec16e6-84d4-43d1-8a8c-34b7c74c2a08 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:05.543614 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fcec16e6-84d4-43d1-8a8c-34b7c74c2a08 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:05.562657 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fcec16e6-84d4-43d1-8a8c-34b7c74c2a08 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:05.563396 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fcec16e6-84d4-43d1-8a8c-34b7c74c2a08 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:05.564646 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fcec16e6-84d4-43d1-8a8c-34b7c74c2a08 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:05.565646 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fcec16e6-84d4-43d1-8a8c-34b7c74c2a08 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:05.781013 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-fcec16e6-84d4-43d1-8a8c-34b7c74c2a08 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] HTTP exception thrown: Instance b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc could not be found. Dec 16 14:41:05.782281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fcec16e6-84d4-43d1-8a8c-34b7c74c2a08 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Returning 404 to user: Instance b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:41:05.783435 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fcec16e6-84d4-43d1-8a8c-34b7c74c2a08 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc" status: 404 len: 111 microversion: 2.1 time: 0.264622 Dec 16 14:41:05.789581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 196/375] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:05 2021] GET /compute/v2.1/servers/b1dfcaa2-9a64-460a-a1a8-e8b04742c7bc => generated 111 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:41:05.890229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:05.890861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:05.907465 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:05.908866 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:05.911003 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:05.912469 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:05.931737 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b981d9ff-d2f3-42fb-a00b-ace41c0c3870 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:05.950620 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b981d9ff-d2f3-42fb-a00b-ace41c0c3870 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 1.068801 Dec 16 14:41:05.954022 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 180/376] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:04 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:06.018168 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1926523719", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "networks": [{"uuid": "5539b773-8751-4335-a9ea-a6672167e589"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:06.126367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] validate_networks() for [('5539b773-8751-4335-a9ea-a6672167e589', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:41:06.311051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:06.346495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:06.362779 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:06.365552 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-86552072-9616-4fea-acf1-20f26ab1fac8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.485226 Dec 16 14:41:06.367065 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 197/377] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:05 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:06.554989 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-75f4e57e-eaaf-4821-8eb6-6e0bdcc01fa5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:06.556115 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-75f4e57e-eaaf-4821-8eb6-6e0bdcc01fa5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:06.569260 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75f4e57e-eaaf-4821-8eb6-6e0bdcc01fa5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:06.569707 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75f4e57e-eaaf-4821-8eb6-6e0bdcc01fa5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:06.570556 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75f4e57e-eaaf-4821-8eb6-6e0bdcc01fa5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:06.571268 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75f4e57e-eaaf-4821-8eb6-6e0bdcc01fa5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.180087 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-75f4e57e-eaaf-4821-8eb6-6e0bdcc01fa5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:07.219959 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-75f4e57e-eaaf-4821-8eb6-6e0bdcc01fa5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.680912 Dec 16 14:41:07.223577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 198/378] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:06 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:07.274385 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c47ca49d-aa40-4108-abdd-a7fe77b54ff9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:07.275921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c47ca49d-aa40-4108-abdd-a7fe77b54ff9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:07.291579 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c47ca49d-aa40-4108-abdd-a7fe77b54ff9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.292622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c47ca49d-aa40-4108-abdd-a7fe77b54ff9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.294647 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c47ca49d-aa40-4108-abdd-a7fe77b54ff9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.295618 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c47ca49d-aa40-4108-abdd-a7fe77b54ff9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.690856 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c47ca49d-aa40-4108-abdd-a7fe77b54ff9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:07.710536 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c47ca49d-aa40-4108-abdd-a7fe77b54ff9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 0.484367 Dec 16 14:41:07.722775 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 199/379] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:07 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:07.740111 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:07.741103 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:07.752886 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.753468 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.754807 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.754807 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.937518 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:41:07.938828 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:41:07.939502 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:41:07.940021 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:41:07.941051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:41:07.956167 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.956608 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.957892 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.958639 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.985958 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Getting quotas for project 755abf4383dc4d3ca3ec465e631d8684. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:41:07.993668 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Getting quotas for user f642c76a379d43fe97078fb43b7477dc and project 755abf4383dc4d3ca3ec465e631d8684. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:41:08.012720 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:41:08.015637 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:41:08.096962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:08.130366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:08.146071 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:08.148749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b410efd9-1363-4750-90a1-c5d0218b1abe tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.424234 Dec 16 14:41:08.154851 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-556899ee-963a-4d81-a062-d35bd00f9cd4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.159663 Dec 16 14:41:08.162695 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 200/380] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:07 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:08.165548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 181/381] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:41:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:41:08.193344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-77b23eea-c260-450d-84e8-11885a677611 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:08.207824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-77b23eea-c260-450d-84e8-11885a677611 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:08.278549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-42bd18b8-7168-4b5c-809a-bc3ccc32bca6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:08.288763 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-42bd18b8-7168-4b5c-809a-bc3ccc32bca6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:08.319054 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-42bd18b8-7168-4b5c-809a-bc3ccc32bca6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:08.321303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-42bd18b8-7168-4b5c-809a-bc3ccc32bca6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:08.322946 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-42bd18b8-7168-4b5c-809a-bc3ccc32bca6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:08.323678 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-42bd18b8-7168-4b5c-809a-bc3ccc32bca6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:08.378604 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-77b23eea-c260-450d-84e8-11885a677611 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:08.401142 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-77b23eea-c260-450d-84e8-11885a677611 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1214 microversion: 2.1 time: 0.233434 Dec 16 14:41:08.401976 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 201/382] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:08 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1214 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:08.758555 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7df44717-6956-4fa8-893e-c87ecc923dc3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:08.759667 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7df44717-6956-4fa8-893e-c87ecc923dc3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:08.787858 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7df44717-6956-4fa8-893e-c87ecc923dc3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:08.788650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7df44717-6956-4fa8-893e-c87ecc923dc3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:08.793263 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7df44717-6956-4fa8-893e-c87ecc923dc3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:08.793263 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7df44717-6956-4fa8-893e-c87ecc923dc3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:08.893534 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-42bd18b8-7168-4b5c-809a-bc3ccc32bca6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:08.915625 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-42bd18b8-7168-4b5c-809a-bc3ccc32bca6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.671062 Dec 16 14:41:08.916526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 182/383] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:08 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:09.191123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:09.192394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:09.216185 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.217140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.219171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.220902 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.237029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7df44717-6956-4fa8-893e-c87ecc923dc3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:09.250802 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7df44717-6956-4fa8-893e-c87ecc923dc3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 0.514517 Dec 16 14:41:09.252407 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 202/384] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:08 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:09.643316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:09.678940 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:09.696642 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:09.697944 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d308145c-7c41-499f-84c1-79a5b5143aa9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.525717 Dec 16 14:41:09.699327 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 183/385] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:09 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:09.734901 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e0a31274-de1a-4c8d-b64c-a7ee7397529b tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:09.739069 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e0a31274-de1a-4c8d-b64c-a7ee7397529b tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:09.758652 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e0a31274-de1a-4c8d-b64c-a7ee7397529b tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.760150 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e0a31274-de1a-4c8d-b64c-a7ee7397529b tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.761753 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e0a31274-de1a-4c8d-b64c-a7ee7397529b tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.763270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e0a31274-de1a-4c8d-b64c-a7ee7397529b tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.995116 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fd39de72-3363-4c2e-9d22-0ac379f45a13 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Action: 'create', calling method: .version_select at 0x7f26fe5fe8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-110580736"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:10.065680 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-fd39de72-3363-4c2e-9d22-0ac379f45a13 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Getting quotas for project 9a687d83941a46d8893bb58f302b2951. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:41:10.077408 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-fd39de72-3363-4c2e-9d22-0ac379f45a13 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Getting quotas for user 60acaee6050143099c2ded8515eab3d3 and project 9a687d83941a46d8893bb58f302b2951. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:41:10.164817 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fd39de72-3363-4c2e-9d22-0ac379f45a13 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [f72844bb-4cc9-4499-be44-29d9113ebc57] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:41:10.387755 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e0a31274-de1a-4c8d-b64c-a7ee7397529b tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:10.416290 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e0a31274-de1a-4c8d-b64c-a7ee7397529b tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1266 microversion: 2.1 time: 0.715372 Dec 16 14:41:10.437101 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 184/386] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:09 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1266 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:10.454416 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-889da11b-f615-4024-9200-280f51ce6508 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:10.462306 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-889da11b-f615-4024-9200-280f51ce6508 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:10.479673 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-889da11b-f615-4024-9200-280f51ce6508 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:10.480906 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-889da11b-f615-4024-9200-280f51ce6508 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:10.483152 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-889da11b-f615-4024-9200-280f51ce6508 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:10.484294 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-889da11b-f615-4024-9200-280f51ce6508 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.126964 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-889da11b-f615-4024-9200-280f51ce6508 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:11.141308 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-889da11b-f615-4024-9200-280f51ce6508 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1522 microversion: 2.1 time: 0.702007 Dec 16 14:41:11.142634 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 185/387] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:10 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1522 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:11.154885 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-524b738f-053b-47c6-913b-1205ad0db388 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:11.155840 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-524b738f-053b-47c6-913b-1205ad0db388 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:11.177372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-524b738f-053b-47c6-913b-1205ad0db388 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:11.178367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-524b738f-053b-47c6-913b-1205ad0db388 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.180145 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-524b738f-053b-47c6-913b-1205ad0db388 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:11.181014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-524b738f-053b-47c6-913b-1205ad0db388 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.206125 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [None req-fd39de72-3363-4c2e-9d22-0ac379f45a13 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [f72844bb-4cc9-4499-be44-29d9113ebc57] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 34020. Dec 16 14:41:11.477093 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-fd39de72-3363-4c2e-9d22-0ac379f45a13 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Getting quotas for project 9a687d83941a46d8893bb58f302b2951. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:41:11.485051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-fd39de72-3363-4c2e-9d22-0ac379f45a13 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Getting quotas for user 60acaee6050143099c2ded8515eab3d3 and project 9a687d83941a46d8893bb58f302b2951. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:41:11.514733 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fd39de72-3363-4c2e-9d22-0ac379f45a13 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 2.260741 Dec 16 14:41:11.515419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 203/388] 10.222.0.67 () {60 vars in 1157 bytes} [Thu Dec 16 14:41:09 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:11.528893 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:11.529498 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:11.545555 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:11.546686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.548453 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:11.549215 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.978976 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-524b738f-053b-47c6-913b-1205ad0db388 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:12.020457 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-524b738f-053b-47c6-913b-1205ad0db388 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 0.874288 Dec 16 14:41:12.022370 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 186/389] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:11 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:12.064820 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-de42e827-fe33-4923-9bb0-03f6202e1ee3 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:12.067555 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-de42e827-fe33-4923-9bb0-03f6202e1ee3 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:12.093737 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-de42e827-fe33-4923-9bb0-03f6202e1ee3 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.095246 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-de42e827-fe33-4923-9bb0-03f6202e1ee3 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:12.096269 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-de42e827-fe33-4923-9bb0-03f6202e1ee3 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.109702 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-de42e827-fe33-4923-9bb0-03f6202e1ee3 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:12.345335 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:12.370474 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:12.378618 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:12.380445 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0177a3e0-d708-46e6-a4be-55a5ebd29383 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.863497 Dec 16 14:41:12.381104 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 204/390] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:11 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:12.406735 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8e746b33-c89c-482c-93ab-4e68f5ab1b4b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:12.407550 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8e746b33-c89c-482c-93ab-4e68f5ab1b4b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:12.418102 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e746b33-c89c-482c-93ab-4e68f5ab1b4b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.419074 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e746b33-c89c-482c-93ab-4e68f5ab1b4b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:12.420142 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e746b33-c89c-482c-93ab-4e68f5ab1b4b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.420808 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e746b33-c89c-482c-93ab-4e68f5ab1b4b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:12.904798 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8e746b33-c89c-482c-93ab-4e68f5ab1b4b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:12.915740 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8e746b33-c89c-482c-93ab-4e68f5ab1b4b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1502 microversion: 2.1 time: 0.532998 Dec 16 14:41:12.927331 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 205/391] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:12 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1502 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:12.955344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-16881234-cdd0-44ee-8c43-f8f0055a5f04 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:12.956166 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-16881234-cdd0-44ee-8c43-f8f0055a5f04 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:12.971586 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16881234-cdd0-44ee-8c43-f8f0055a5f04 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.972999 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16881234-cdd0-44ee-8c43-f8f0055a5f04 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:12.975052 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16881234-cdd0-44ee-8c43-f8f0055a5f04 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.975792 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16881234-cdd0-44ee-8c43-f8f0055a5f04 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.063203 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-de42e827-fe33-4923-9bb0-03f6202e1ee3 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:13.085938 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-de42e827-fe33-4923-9bb0-03f6202e1ee3 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 1.061579 Dec 16 14:41:13.086670 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 187/392] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:12 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:13.108947 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d5f3a58c-47b1-4404-8b8a-7bc25d23c387 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:13.117433 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d5f3a58c-47b1-4404-8b8a-7bc25d23c387 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:13.139321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5f3a58c-47b1-4404-8b8a-7bc25d23c387 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.139936 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5f3a58c-47b1-4404-8b8a-7bc25d23c387 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.140751 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5f3a58c-47b1-4404-8b8a-7bc25d23c387 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.141190 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5f3a58c-47b1-4404-8b8a-7bc25d23c387 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.426226 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-16881234-cdd0-44ee-8c43-f8f0055a5f04 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:13.439151 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-16881234-cdd0-44ee-8c43-f8f0055a5f04 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1516 microversion: 2.1 time: 0.504284 Dec 16 14:41:13.440104 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 206/393] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:12 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1516 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:13.453733 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:13.455234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:13.466324 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.466597 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.467796 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.468427 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.851545 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d5f3a58c-47b1-4404-8b8a-7bc25d23c387 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:13.890674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d5f3a58c-47b1-4404-8b8a-7bc25d23c387 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 0.801022 Dec 16 14:41:13.903515 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 188/394] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:13 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:13.936198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:13.980242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:13.997378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:14.000406 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e17868a3-ce88-4690-9650-88b212009896 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1744 microversion: 2.20 time: 0.558663 Dec 16 14:41:14.002791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 207/395] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:13 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1744 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:14.119542 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cd4d7c2f-ed7f-4f9b-94e7-265ae103c1f6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:14.125143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cd4d7c2f-ed7f-4f9b-94e7-265ae103c1f6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:14.149841 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd4d7c2f-ed7f-4f9b-94e7-265ae103c1f6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:14.150678 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd4d7c2f-ed7f-4f9b-94e7-265ae103c1f6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:14.156656 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd4d7c2f-ed7f-4f9b-94e7-265ae103c1f6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:14.157967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd4d7c2f-ed7f-4f9b-94e7-265ae103c1f6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:14.768869 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:41:14.768869 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: Thu Dec 16 14:41:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 (ip 10.222.0.67) !!! Dec 16 14:41:14.924034 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4e75756c-03c0-4230-8db4-5f20b6255fdf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:14.924984 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4e75756c-03c0-4230-8db4-5f20b6255fdf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:14.961812 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4e75756c-03c0-4230-8db4-5f20b6255fdf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:14.962587 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4e75756c-03c0-4230-8db4-5f20b6255fdf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:14.964252 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4e75756c-03c0-4230-8db4-5f20b6255fdf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:14.964980 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4e75756c-03c0-4230-8db4-5f20b6255fdf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:14.974768 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cd4d7c2f-ed7f-4f9b-94e7-265ae103c1f6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:15.002883 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cd4d7c2f-ed7f-4f9b-94e7-265ae103c1f6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 0.899135 Dec 16 14:41:15.006966 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 189/396] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:14 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:15.050788 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:15.053142 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:15.073459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:15.074126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:15.075270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:15.076201 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:15.647324 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:15.672561 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:15.691303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:15.700585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e2cfa7da-b08f-4af9-a555-22aecff2f055 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1744 microversion: 2.20 time: 0.672395 Dec 16 14:41:15.716987 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 190/397] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:15 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1744 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:15.739981 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-7f7ac5a6-3f09-420c-9a47-e2e36387a9b3 req-0583be25-54f7-49f4-ab61-44822d05577f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c28e5c9-7dd1-493d-a812-10367a49ad01", "tag": "11b0cec4-410e-43d4-a952-a07f61931613"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:15.752980 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:15.752980 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:41:15.780277 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-7f7ac5a6-3f09-420c-9a47-e2e36387a9b3 req-0583be25-54f7-49f4-ab61-44822d05577f service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:15.783493 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-7f7ac5a6-3f09-420c-9a47-e2e36387a9b3 req-0583be25-54f7-49f4-ab61-44822d05577f service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:15.818541 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4e75756c-03c0-4230-8db4-5f20b6255fdf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:15.832300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-7f7ac5a6-3f09-420c-9a47-e2e36387a9b3 req-0583be25-54f7-49f4-ab61-44822d05577f service nova] Creating event network-changed:11b0cec4-410e-43d4-a952-a07f61931613 for instance 0c28e5c9-7dd1-493d-a812-10367a49ad01 on hv-cinder-82189 Dec 16 14:41:15.850986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4e75756c-03c0-4230-8db4-5f20b6255fdf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 0.940279 Dec 16 14:41:15.859011 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-7f7ac5a6-3f09-420c-9a47-e2e36387a9b3 req-0583be25-54f7-49f4-ab61-44822d05577f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140476 Dec 16 14:41:15.860522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 191/398] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:15.867036 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 208/399] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:14 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:16.054921 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4fc0abeb-654c-41b7-b97d-3c6a2a7c6882 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:16.057292 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4fc0abeb-654c-41b7-b97d-3c6a2a7c6882 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:16.067407 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4fc0abeb-654c-41b7-b97d-3c6a2a7c6882 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.072079 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4fc0abeb-654c-41b7-b97d-3c6a2a7c6882 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.072079 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4fc0abeb-654c-41b7-b97d-3c6a2a7c6882 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.072079 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4fc0abeb-654c-41b7-b97d-3c6a2a7c6882 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.073302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-10055698-53dd-4b37-bdb0-42002cc7b4e6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:16.073302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-10055698-53dd-4b37-bdb0-42002cc7b4e6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:16.094385 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-10055698-53dd-4b37-bdb0-42002cc7b4e6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.095296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-10055698-53dd-4b37-bdb0-42002cc7b4e6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.096849 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-10055698-53dd-4b37-bdb0-42002cc7b4e6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.097685 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-10055698-53dd-4b37-bdb0-42002cc7b4e6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.171829 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.objects.instance [None req-4fc0abeb-654c-41b7-b97d-3c6a2a7c6882 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lazy-loading 'flavor' on Instance uuid 618e7310-603e-4003-b2d6-b05eb18cd558 {{(pid=96669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:41:16.632244 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4fc0abeb-654c-41b7-b97d-3c6a2a7c6882 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/action" status: 200 len: 32 microversion: 2.1 time: 0.587153 Dec 16 14:41:16.639347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 192/400] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:41:16 2021] POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/action => generated 32 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:41:16.696268 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3f24421f-7e24-4a8b-9f0a-4ddbb93922e5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:16.701480 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3f24421f-7e24-4a8b-9f0a-4ddbb93922e5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:16.721977 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f24421f-7e24-4a8b-9f0a-4ddbb93922e5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.722671 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f24421f-7e24-4a8b-9f0a-4ddbb93922e5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.723805 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f24421f-7e24-4a8b-9f0a-4ddbb93922e5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.724242 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f24421f-7e24-4a8b-9f0a-4ddbb93922e5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:17.003844 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-10055698-53dd-4b37-bdb0-42002cc7b4e6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:17.043758 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-10055698-53dd-4b37-bdb0-42002cc7b4e6 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 1.007661 Dec 16 14:41:17.045704 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 209/401] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:16 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:17.088080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:17.103380 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:17.128176 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:17.135312 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:17.139835 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:17.141118 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:17.371470 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3f24421f-7e24-4a8b-9f0a-4ddbb93922e5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:17.394440 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3f24421f-7e24-4a8b-9f0a-4ddbb93922e5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.743777 Dec 16 14:41:17.396641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 193/402] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:16 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:17.424084 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8e32a2e1-acf0-4786-b57e-50c3f1a7c632 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:17.424695 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8e32a2e1-acf0-4786-b57e-50c3f1a7c632 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:17.441693 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8e32a2e1-acf0-4786-b57e-50c3f1a7c632 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:17.442389 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8e32a2e1-acf0-4786-b57e-50c3f1a7c632 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:17.443577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8e32a2e1-acf0-4786-b57e-50c3f1a7c632 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:17.443781 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8e32a2e1-acf0-4786-b57e-50c3f1a7c632 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.315365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:18.422296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:18.449118 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:18.460385 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f1f05e75-90a8-4b00-9948-13822fa70483 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1744 microversion: 2.20 time: 1.412322 Dec 16 14:41:18.461787 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 210/403] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:17 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1744 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:18.502155 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-229515be-1d5d-4df5-9838-40be8d4735fc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:18.507177 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-229515be-1d5d-4df5-9838-40be8d4735fc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:18.545650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-229515be-1d5d-4df5-9838-40be8d4735fc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.550220 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-229515be-1d5d-4df5-9838-40be8d4735fc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.555302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-229515be-1d5d-4df5-9838-40be8d4735fc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.559161 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-229515be-1d5d-4df5-9838-40be8d4735fc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.595909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8e32a2e1-acf0-4786-b57e-50c3f1a7c632 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:18.637122 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8e32a2e1-acf0-4786-b57e-50c3f1a7c632 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 1.237545 Dec 16 14:41:18.642898 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 194/404] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:17 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:18.684573 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7765bb5b-8984-402a-9a42-3d591bcbc6b8 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:18.685832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7765bb5b-8984-402a-9a42-3d591bcbc6b8 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:18.710544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7765bb5b-8984-402a-9a42-3d591bcbc6b8 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.712103 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7765bb5b-8984-402a-9a42-3d591bcbc6b8 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.713873 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7765bb5b-8984-402a-9a42-3d591bcbc6b8 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.716027 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7765bb5b-8984-402a-9a42-3d591bcbc6b8 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:19.817217 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-229515be-1d5d-4df5-9838-40be8d4735fc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:19.858892 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-229515be-1d5d-4df5-9838-40be8d4735fc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 1.393227 Dec 16 14:41:19.862094 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 211/405] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:18 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:19.893588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:19.896851 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:19.911652 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:19.912424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:19.913895 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:19.914638 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.324166 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7765bb5b-8984-402a-9a42-3d591bcbc6b8 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:20.341271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7765bb5b-8984-402a-9a42-3d591bcbc6b8 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 1.695267 Dec 16 14:41:20.342372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 195/406] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:18 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:20.360124 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9f926ce1-7792-42f9-8123-7981b3ad94bd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:20.361530 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9f926ce1-7792-42f9-8123-7981b3ad94bd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:20.367711 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:20.375832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9f926ce1-7792-42f9-8123-7981b3ad94bd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.376972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9f926ce1-7792-42f9-8123-7981b3ad94bd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.378546 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9f926ce1-7792-42f9-8123-7981b3ad94bd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.379563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9f926ce1-7792-42f9-8123-7981b3ad94bd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.405252 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:20.424223 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:20.428885 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b2e3abca-77a5-4a22-bcc7-038aac8a27c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1744 microversion: 2.20 time: 0.563391 Dec 16 14:41:20.430400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 212/407] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:19 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1744 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:20.524586 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-a02f8b9d-6d2f-4b74-8431-1e98ef8abc89 req-82988b62-eb03-4b07-9fdd-c761a8c900a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b5c02-69ca-4290-bba0-54d6ed2eb215", "name": "network-vif-plugged", "status": "completed", "tag": "e59517d2-2291-4c73-889e-594d9cc076e2"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:20.531535 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:20.531535 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:41:20.567663 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-a02f8b9d-6d2f-4b74-8431-1e98ef8abc89 req-82988b62-eb03-4b07-9fdd-c761a8c900a4 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.569557 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-a02f8b9d-6d2f-4b74-8431-1e98ef8abc89 req-82988b62-eb03-4b07-9fdd-c761a8c900a4 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.621562 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-a02f8b9d-6d2f-4b74-8431-1e98ef8abc89 req-82988b62-eb03-4b07-9fdd-c761a8c900a4 service nova] Creating event network-vif-plugged:e59517d2-2291-4c73-889e-594d9cc076e2 for instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 on hv-cinder-82189 Dec 16 14:41:20.657112 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-a02f8b9d-6d2f-4b74-8431-1e98ef8abc89 req-82988b62-eb03-4b07-9fdd-c761a8c900a4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151066 Dec 16 14:41:20.658573 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 213/408] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:20.917301 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9f926ce1-7792-42f9-8123-7981b3ad94bd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:20.920599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-65056564-043e-465d-9397-868f72eab028 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:20.924086 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-65056564-043e-465d-9397-868f72eab028 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:20.933434 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9f926ce1-7792-42f9-8123-7981b3ad94bd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 0.588970 Dec 16 14:41:20.934373 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 196/409] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:20 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:20.946085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65056564-043e-465d-9397-868f72eab028 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.947214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65056564-043e-465d-9397-868f72eab028 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.950667 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65056564-043e-465d-9397-868f72eab028 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.951947 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65056564-043e-465d-9397-868f72eab028 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.383082 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cb8da943-ad98-418c-9629-777ebfd06da4 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:21.384263 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cb8da943-ad98-418c-9629-777ebfd06da4 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:21.409926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cb8da943-ad98-418c-9629-777ebfd06da4 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.410581 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cb8da943-ad98-418c-9629-777ebfd06da4 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.411431 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cb8da943-ad98-418c-9629-777ebfd06da4 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.411892 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cb8da943-ad98-418c-9629-777ebfd06da4 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.445475 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-65056564-043e-465d-9397-868f72eab028 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:21.471221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-65056564-043e-465d-9397-868f72eab028 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 0.594954 Dec 16 14:41:21.472725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 214/410] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:20 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:21.557132 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:21.560699 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:21.581376 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.587489 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.605692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.606841 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:22.058505 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cb8da943-ad98-418c-9629-777ebfd06da4 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:22.074405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cb8da943-ad98-418c-9629-777ebfd06da4 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.711051 Dec 16 14:41:22.077219 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 197/411] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:21 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:22.097325 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a49a4864-9d11-49b8-855c-62e2b859a7dc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:22.109502 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a49a4864-9d11-49b8-855c-62e2b859a7dc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:22.135597 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a49a4864-9d11-49b8-855c-62e2b859a7dc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:22.145173 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a49a4864-9d11-49b8-855c-62e2b859a7dc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:22.147339 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a49a4864-9d11-49b8-855c-62e2b859a7dc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:22.167411 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a49a4864-9d11-49b8-855c-62e2b859a7dc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:22.781812 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:22.801572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a49a4864-9d11-49b8-855c-62e2b859a7dc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:22.853551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a49a4864-9d11-49b8-855c-62e2b859a7dc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 0.774391 Dec 16 14:41:22.856064 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 198/412] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:22 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:22.871861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:22.880652 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1a9ecaed-024c-402a-85d1-d31a5f63c873 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:22.882257 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1a9ecaed-024c-402a-85d1-d31a5f63c873 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:22.894860 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:22.897695 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-362759cf-abbd-4e63-9edc-c78b6a022c2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 1.422933 Dec 16 14:41:22.898142 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1a9ecaed-024c-402a-85d1-d31a5f63c873 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:22.898906 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1a9ecaed-024c-402a-85d1-d31a5f63c873 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:22.900269 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1a9ecaed-024c-402a-85d1-d31a5f63c873 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:22.905614 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1a9ecaed-024c-402a-85d1-d31a5f63c873 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:22.916098 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 215/413] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:21 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:23.122568 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-51c514d4-d262-4386-a192-ce2835c48dab tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:23.123356 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-51c514d4-d262-4386-a192-ce2835c48dab tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:23.154583 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51c514d4-d262-4386-a192-ce2835c48dab tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:23.155025 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51c514d4-d262-4386-a192-ce2835c48dab tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:23.155840 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51c514d4-d262-4386-a192-ce2835c48dab tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:23.162369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51c514d4-d262-4386-a192-ce2835c48dab tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:23.771955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1a9ecaed-024c-402a-85d1-d31a5f63c873 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:23.804647 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1a9ecaed-024c-402a-85d1-d31a5f63c873 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 0.946226 Dec 16 14:41:23.819664 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 199/414] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:22 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:23.895065 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-990e4954-71aa-4624-97b8-a6d511e38f24 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:23.896697 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-990e4954-71aa-4624-97b8-a6d511e38f24 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:23.917145 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-990e4954-71aa-4624-97b8-a6d511e38f24 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:23.919288 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-990e4954-71aa-4624-97b8-a6d511e38f24 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:23.920353 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-990e4954-71aa-4624-97b8-a6d511e38f24 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:23.922935 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-990e4954-71aa-4624-97b8-a6d511e38f24 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:24.061154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-51c514d4-d262-4386-a192-ce2835c48dab tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:24.073817 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-51c514d4-d262-4386-a192-ce2835c48dab tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.971955 Dec 16 14:41:24.086298 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 216/415] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:23 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:24.102899 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:24.103963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:24.116384 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:41:24.118476 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: Thu Dec 16 14:41:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 (ip 10.222.0.67) !!! Dec 16 14:41:24.133671 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:24.134849 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:24.136647 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:24.137377 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:24.899505 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-990e4954-71aa-4624-97b8-a6d511e38f24 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:24.923146 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-990e4954-71aa-4624-97b8-a6d511e38f24 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1724 microversion: 2.1 time: 1.041960 Dec 16 14:41:24.924760 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 200/416] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:23 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1724 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:24.956927 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8f4f6420-aa0e-4827-9b90-49129eb6d511 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:24.958579 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8f4f6420-aa0e-4827-9b90-49129eb6d511 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:24.983564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8f4f6420-aa0e-4827-9b90-49129eb6d511 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:24.991746 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8f4f6420-aa0e-4827-9b90-49129eb6d511 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:24.992758 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8f4f6420-aa0e-4827-9b90-49129eb6d511 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:24.993364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8f4f6420-aa0e-4827-9b90-49129eb6d511 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.081886 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:25.098719 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:25.139447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:25.142363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a9a45099-d85f-4168-aecc-30a3b287458c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 1.053576 Dec 16 14:41:25.143462 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 217/417] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:24 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:25.198718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6a52f414-abe8-4c79-8caa-9da5f6cfbc6e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:25.211662 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6a52f414-abe8-4c79-8caa-9da5f6cfbc6e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:25.252932 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a52f414-abe8-4c79-8caa-9da5f6cfbc6e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.260240 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a52f414-abe8-4c79-8caa-9da5f6cfbc6e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.265693 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a52f414-abe8-4c79-8caa-9da5f6cfbc6e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.267130 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a52f414-abe8-4c79-8caa-9da5f6cfbc6e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.838008 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6a52f414-abe8-4c79-8caa-9da5f6cfbc6e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:25.857073 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6a52f414-abe8-4c79-8caa-9da5f6cfbc6e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.711152 Dec 16 14:41:25.858759 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 218/418] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:25 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:25.893609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8f4f6420-aa0e-4827-9b90-49129eb6d511 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:25.911608 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8f4f6420-aa0e-4827-9b90-49129eb6d511 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 0.984467 Dec 16 14:41:25.912715 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 201/419] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:24 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:25.989775 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-55f230fb-2c2c-495e-9b78-e5645efc89f1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:25.999763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-55f230fb-2c2c-495e-9b78-e5645efc89f1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:26.019256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-55f230fb-2c2c-495e-9b78-e5645efc89f1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.020241 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-55f230fb-2c2c-495e-9b78-e5645efc89f1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.022154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-55f230fb-2c2c-495e-9b78-e5645efc89f1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.023265 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-55f230fb-2c2c-495e-9b78-e5645efc89f1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.211187 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:26.217813 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:26.255460 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.257456 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.258887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.259691 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.742128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-55f230fb-2c2c-495e-9b78-e5645efc89f1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:26.784433 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-55f230fb-2c2c-495e-9b78-e5645efc89f1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1701 microversion: 2.1 time: 0.831672 Dec 16 14:41:26.785288 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 219/420] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:25 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1701 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:26.834801 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6fd66a77-26e7-484d-a30e-f4dc5d55f535 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:26.858749 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:26.883066 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6fd66a77-26e7-484d-a30e-f4dc5d55f535 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.887804 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6fd66a77-26e7-484d-a30e-f4dc5d55f535 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.973674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:27.032993 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:27.046795 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-666fbe32-3cf5-483e-be22-c847186cb8cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.859356 Dec 16 14:41:27.051605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 202/421] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:26 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:27.130273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-13faa1a7-e747-410f-8e2d-60995d07a581 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:27.131539 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-13faa1a7-e747-410f-8e2d-60995d07a581 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:27.146781 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6fd66a77-26e7-484d-a30e-f4dc5d55f535 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Going to try to start instance {{(pid=96670) start /opt/stack/nova/nova/compute/api.py:2622}} Dec 16 14:41:27.162023 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-13faa1a7-e747-410f-8e2d-60995d07a581 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:27.165127 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-13faa1a7-e747-410f-8e2d-60995d07a581 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:27.170604 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-13faa1a7-e747-410f-8e2d-60995d07a581 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:27.171514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-13faa1a7-e747-410f-8e2d-60995d07a581 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:27.370721 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6fd66a77-26e7-484d-a30e-f4dc5d55f535 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 202 len: 0 microversion: 2.1 time: 0.555420 Dec 16 14:41:27.371730 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 220/422] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:41:26 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:41:27.387490 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-75f3210d-83b9-4274-bdce-965f2ccc7188 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:27.389543 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-75f3210d-83b9-4274-bdce-965f2ccc7188 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:27.403752 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75f3210d-83b9-4274-bdce-965f2ccc7188 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:27.404753 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75f3210d-83b9-4274-bdce-965f2ccc7188 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:27.407045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75f3210d-83b9-4274-bdce-965f2ccc7188 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:27.408558 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75f3210d-83b9-4274-bdce-965f2ccc7188 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.096547 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-13faa1a7-e747-410f-8e2d-60995d07a581 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:28.132853 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-13faa1a7-e747-410f-8e2d-60995d07a581 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 1.074089 Dec 16 14:41:28.144928 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 203/423] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:27 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:28.187308 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-75ab0163-50e7-4ae6-b6fc-799d466b1452 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:28.190738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-75ab0163-50e7-4ae6-b6fc-799d466b1452 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:28.208797 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-75ab0163-50e7-4ae6-b6fc-799d466b1452 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.215531 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-75ab0163-50e7-4ae6-b6fc-799d466b1452 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.217377 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-75ab0163-50e7-4ae6-b6fc-799d466b1452 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.218367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-75ab0163-50e7-4ae6-b6fc-799d466b1452 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.309728 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-75f3210d-83b9-4274-bdce-965f2ccc7188 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:28.346281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-75f3210d-83b9-4274-bdce-965f2ccc7188 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 0.972822 Dec 16 14:41:28.352409 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 221/424] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:27 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:28.397697 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:28.406540 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:28.444873 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.473474 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.475052 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.477800 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.312873 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:29.357689 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:29.371478 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:29.374099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-dbed943b-968c-4868-9437-3fec1745cbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 1.019560 Dec 16 14:41:29.375362 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 222/425] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:28 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:29.395737 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-03ee6102-a347-40f1-ab8e-acbc87d70ae4 req-ff65c3c7-2003-450b-8f23-273a440e2b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c28e5c9-7dd1-493d-a812-10367a49ad01", "name": "network-vif-plugged", "status": "completed", "tag": "11b0cec4-410e-43d4-a952-a07f61931613"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:29.410690 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:29.410690 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:41:29.427623 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-03ee6102-a347-40f1-ab8e-acbc87d70ae4 req-ff65c3c7-2003-450b-8f23-273a440e2b36 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.429470 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-03ee6102-a347-40f1-ab8e-acbc87d70ae4 req-ff65c3c7-2003-450b-8f23-273a440e2b36 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.467436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-03ee6102-a347-40f1-ab8e-acbc87d70ae4 req-ff65c3c7-2003-450b-8f23-273a440e2b36 service nova] Creating event network-vif-plugged:11b0cec4-410e-43d4-a952-a07f61931613 for instance 0c28e5c9-7dd1-493d-a812-10367a49ad01 on hv-cinder-82189 Dec 16 14:41:29.477121 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-03ee6102-a347-40f1-ab8e-acbc87d70ae4 req-ff65c3c7-2003-450b-8f23-273a440e2b36 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099439 Dec 16 14:41:29.479493 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 223/426] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:29.489456 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-75ab0163-50e7-4ae6-b6fc-799d466b1452 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:29.502360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-75ab0163-50e7-4ae6-b6fc-799d466b1452 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1710 microversion: 2.1 time: 1.355498 Dec 16 14:41:29.502929 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 204/427] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:28 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1710 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:29.507465 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7ec43ddb-9918-496c-9a92-d4fae1d441ae tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:29.509352 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7ec43ddb-9918-496c-9a92-d4fae1d441ae tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:29.517432 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-eb6f6e7e-b8b3-4408-9844-d35f8039fd9d tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:29.525524 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7ec43ddb-9918-496c-9a92-d4fae1d441ae tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.526421 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7ec43ddb-9918-496c-9a92-d4fae1d441ae tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.528199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7ec43ddb-9918-496c-9a92-d4fae1d441ae tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.528898 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7ec43ddb-9918-496c-9a92-d4fae1d441ae tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.540804 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-eb6f6e7e-b8b3-4408-9844-d35f8039fd9d tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:29.581314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eb6f6e7e-b8b3-4408-9844-d35f8039fd9d tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.582607 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eb6f6e7e-b8b3-4408-9844-d35f8039fd9d tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.584437 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eb6f6e7e-b8b3-4408-9844-d35f8039fd9d tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.585518 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eb6f6e7e-b8b3-4408-9844-d35f8039fd9d tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.202351 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7ec43ddb-9918-496c-9a92-d4fae1d441ae tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:30.258764 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7ec43ddb-9918-496c-9a92-d4fae1d441ae tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.776055 Dec 16 14:41:30.259535 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 224/428] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:29 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:30.424820 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:30.427269 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:30.443634 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.444869 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.446645 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.447623 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.714889 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-eb6f6e7e-b8b3-4408-9844-d35f8039fd9d tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:30.737367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-eb6f6e7e-b8b3-4408-9844-d35f8039fd9d tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 1.232723 Dec 16 14:41:30.746076 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 205/429] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:29 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:30.773637 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2886eca4-fc77-469f-9d29-6ec541130863 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:30.774609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2886eca4-fc77-469f-9d29-6ec541130863 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:30.783018 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2886eca4-fc77-469f-9d29-6ec541130863 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.783449 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2886eca4-fc77-469f-9d29-6ec541130863 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.784629 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2886eca4-fc77-469f-9d29-6ec541130863 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.785602 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2886eca4-fc77-469f-9d29-6ec541130863 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.134186 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:31.166027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:31.185436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:31.188138 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a6e63b00-c380-4bdd-be27-f033406b2b7a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.788796 Dec 16 14:41:31.194072 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 225/430] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:30 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:31.319916 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d448ea4c-711e-4f6a-9c01-c1fb241abc8f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:31.322499 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d448ea4c-711e-4f6a-9c01-c1fb241abc8f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:31.348579 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d448ea4c-711e-4f6a-9c01-c1fb241abc8f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.349882 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d448ea4c-711e-4f6a-9c01-c1fb241abc8f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.352018 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d448ea4c-711e-4f6a-9c01-c1fb241abc8f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.352736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d448ea4c-711e-4f6a-9c01-c1fb241abc8f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.395293 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2886eca4-fc77-469f-9d29-6ec541130863 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:31.444639 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2886eca4-fc77-469f-9d29-6ec541130863 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1710 microversion: 2.1 time: 0.683817 Dec 16 14:41:31.446787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 206/431] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:30 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1710 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:31.807477 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-67032742-68f6-4502-9a3c-42ec7271b1af tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:31.816836 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-67032742-68f6-4502-9a3c-42ec7271b1af tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:31.846255 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-67032742-68f6-4502-9a3c-42ec7271b1af tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.849634 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-67032742-68f6-4502-9a3c-42ec7271b1af tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.853368 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-67032742-68f6-4502-9a3c-42ec7271b1af tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.856177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-67032742-68f6-4502-9a3c-42ec7271b1af tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.914294 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d448ea4c-711e-4f6a-9c01-c1fb241abc8f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:31.950485 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d448ea4c-711e-4f6a-9c01-c1fb241abc8f tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.670040 Dec 16 14:41:31.961910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 226/432] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:31 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:32.245044 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:32.246234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:32.278578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.280932 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.282278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.293649 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.515570 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-67032742-68f6-4502-9a3c-42ec7271b1af tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:32.529815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-67032742-68f6-4502-9a3c-42ec7271b1af tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1314 microversion: 2.1 time: 0.767411 Dec 16 14:41:32.531318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 207/433] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:31 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:32.549559 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-da5b9904-91bb-4b3e-b3ec-ee62497ae9e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:32.550224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-da5b9904-91bb-4b3e-b3ec-ee62497ae9e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:32.559750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-da5b9904-91bb-4b3e-b3ec-ee62497ae9e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.560196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-da5b9904-91bb-4b3e-b3ec-ee62497ae9e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.561278 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-da5b9904-91bb-4b3e-b3ec-ee62497ae9e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.561904 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-da5b9904-91bb-4b3e-b3ec-ee62497ae9e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.735436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:32.783248 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:32.795824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:32.798135 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d12adddf-8df7-445e-bf3a-fa3ecf159cbf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.590661 Dec 16 14:41:32.799198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 227/434] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:32 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:33.013021 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5a6675fe-0ef9-4034-a69d-af9b62032ca9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:33.017813 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5a6675fe-0ef9-4034-a69d-af9b62032ca9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:33.027649 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-da5b9904-91bb-4b3e-b3ec-ee62497ae9e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:33.039089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a6675fe-0ef9-4034-a69d-af9b62032ca9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.040550 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a6675fe-0ef9-4034-a69d-af9b62032ca9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.042119 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a6675fe-0ef9-4034-a69d-af9b62032ca9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.043355 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a6675fe-0ef9-4034-a69d-af9b62032ca9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.049666 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-da5b9904-91bb-4b3e-b3ec-ee62497ae9e8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1714 microversion: 2.1 time: 0.515983 Dec 16 14:41:33.062934 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 208/435] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:32 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1714 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:33.535089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5a6675fe-0ef9-4034-a69d-af9b62032ca9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:33.555447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5a6675fe-0ef9-4034-a69d-af9b62032ca9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.587318 Dec 16 14:41:33.557058 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 228/436] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:32 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:33.573761 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d7662f1c-f0e6-43a6-a55f-abcd830e189a tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:33.574369 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d7662f1c-f0e6-43a6-a55f-abcd830e189a tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:33.583229 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7662f1c-f0e6-43a6-a55f-abcd830e189a tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.583700 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7662f1c-f0e6-43a6-a55f-abcd830e189a tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.596067 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7662f1c-f0e6-43a6-a55f-abcd830e189a tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.596067 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7662f1c-f0e6-43a6-a55f-abcd830e189a tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.832352 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:33.833632 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:33.845910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.846892 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.848037 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.848698 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:34.087882 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d7662f1c-f0e6-43a6-a55f-abcd830e189a tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:34.104628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d7662f1c-f0e6-43a6-a55f-abcd830e189a tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1497 microversion: 2.1 time: 0.547821 Dec 16 14:41:34.105217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 209/437] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:33 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1497 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:34.287978 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:34.324084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:34.339466 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:34.341508 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d5cc3511-ee83-487c-8e44-3c0d14b5a686 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.523186 Dec 16 14:41:34.345851 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 229/438] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:33 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:34.604448 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-669425dc-5239-4814-b78b-4da8b28b0402 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:34.605916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-669425dc-5239-4814-b78b-4da8b28b0402 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:34.620778 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-669425dc-5239-4814-b78b-4da8b28b0402 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:34.621910 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-669425dc-5239-4814-b78b-4da8b28b0402 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:34.623452 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-669425dc-5239-4814-b78b-4da8b28b0402 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:34.624121 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-669425dc-5239-4814-b78b-4da8b28b0402 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:35.019827 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-669425dc-5239-4814-b78b-4da8b28b0402 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:35.049091 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-669425dc-5239-4814-b78b-4da8b28b0402 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.466399 Dec 16 14:41:35.050242 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 210/439] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:34 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:35.371210 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:35.372103 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:35.383831 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:35.384381 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:35.385275 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:35.385774 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:35.722464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:35.745247 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:35.756482 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:35.758251 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-af3f0780-051a-472d-b819-69136b147c0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.398548 Dec 16 14:41:35.768016 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 230/440] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:35 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:36.090335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a15f39a1-8e38-4d76-8137-8310b28e1eb5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:36.092599 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a15f39a1-8e38-4d76-8137-8310b28e1eb5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:36.109690 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a15f39a1-8e38-4d76-8137-8310b28e1eb5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:36.110972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a15f39a1-8e38-4d76-8137-8310b28e1eb5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:36.112862 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a15f39a1-8e38-4d76-8137-8310b28e1eb5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:36.113975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a15f39a1-8e38-4d76-8137-8310b28e1eb5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:36.522459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a15f39a1-8e38-4d76-8137-8310b28e1eb5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:36.539508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a15f39a1-8e38-4d76-8137-8310b28e1eb5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.469753 Dec 16 14:41:36.540975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 211/441] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:36 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:36.796637 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:36.799170 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:36.814791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:36.816024 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:36.817907 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:36.819127 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.290395 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:37.322123 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:37.358033 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:37.358033 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-28c56ae2-29e0-4531-bc3b-c53794270e09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.562529 Dec 16 14:41:37.358033 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 231/442] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:36 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:37.588882 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9e90bb0b-aaf8-48bf-8eba-5ffc99f18f60 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:37.589726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9e90bb0b-aaf8-48bf-8eba-5ffc99f18f60 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:37.605204 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9e90bb0b-aaf8-48bf-8eba-5ffc99f18f60 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.606161 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9e90bb0b-aaf8-48bf-8eba-5ffc99f18f60 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.608030 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9e90bb0b-aaf8-48bf-8eba-5ffc99f18f60 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.608819 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9e90bb0b-aaf8-48bf-8eba-5ffc99f18f60 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:38.261851 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9e90bb0b-aaf8-48bf-8eba-5ffc99f18f60 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:38.275715 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9e90bb0b-aaf8-48bf-8eba-5ffc99f18f60 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.711468 Dec 16 14:41:38.286629 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 212/443] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:37 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:38.394197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:38.395045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:38.410588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:38.411771 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:38.413486 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:38.414611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:38.883648 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:38.915728 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:38.931772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:38.934772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6d59262e-0ee9-4760-a71c-f3bae9d36d47 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.559118 Dec 16 14:41:38.936468 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 232/444] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:38 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:39.316903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-540cd7f0-8f2b-4e64-bfe5-f9b73aa12c97 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:39.318183 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-540cd7f0-8f2b-4e64-bfe5-f9b73aa12c97 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:39.341274 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-540cd7f0-8f2b-4e64-bfe5-f9b73aa12c97 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:39.349888 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-540cd7f0-8f2b-4e64-bfe5-f9b73aa12c97 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:39.352127 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-540cd7f0-8f2b-4e64-bfe5-f9b73aa12c97 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:39.358300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-540cd7f0-8f2b-4e64-bfe5-f9b73aa12c97 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:39.966416 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-540cd7f0-8f2b-4e64-bfe5-f9b73aa12c97 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:39.971126 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:39.971957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:39.994364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-540cd7f0-8f2b-4e64-bfe5-f9b73aa12c97 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.702681 Dec 16 14:41:40.001097 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:40.002216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:40.003786 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 213/445] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:39 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:40.006758 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:40.008120 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:40.433354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:40.463627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:40.472939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:40.474686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-acec0308-024f-4683-bccd-b9c55fb700dd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.515270 Dec 16 14:41:40.475560 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 233/446] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:39 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:41.031585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-35126570-1684-4c94-8e1e-c4f0d62e2c9c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:41.036147 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-35126570-1684-4c94-8e1e-c4f0d62e2c9c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:41.053947 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f43c639c-4e99-4d8c-b87c-7aa64e94fafa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:41.056037 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f43c639c-4e99-4d8c-b87c-7aa64e94fafa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:41.066734 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-35126570-1684-4c94-8e1e-c4f0d62e2c9c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.076586 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f43c639c-4e99-4d8c-b87c-7aa64e94fafa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.077047 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f43c639c-4e99-4d8c-b87c-7aa64e94fafa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.078026 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-35126570-1684-4c94-8e1e-c4f0d62e2c9c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.078801 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f43c639c-4e99-4d8c-b87c-7aa64e94fafa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.079436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f43c639c-4e99-4d8c-b87c-7aa64e94fafa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.080878 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-35126570-1684-4c94-8e1e-c4f0d62e2c9c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.082119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-35126570-1684-4c94-8e1e-c4f0d62e2c9c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.357834 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-35126570-1684-4c94-8e1e-c4f0d62e2c9c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:41:41.444366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f43c639c-4e99-4d8c-b87c-7aa64e94fafa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:41.467795 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f43c639c-4e99-4d8c-b87c-7aa64e94fafa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.436225 Dec 16 14:41:41.482918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 234/447] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:41 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:41.523092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:41.524534 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:41.533668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.534411 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.535262 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.535958 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.570394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-35126570-1684-4c94-8e1e-c4f0d62e2c9c tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 204 len: 0 microversion: 2.1 time: 0.568724 Dec 16 14:41:41.574958 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 214/448] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:41:40 2021] DELETE /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:41:41.601265 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e15a86c6-8c45-4b71-82d6-cabc06d8fa36 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:41.602414 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e15a86c6-8c45-4b71-82d6-cabc06d8fa36 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:41.613606 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e15a86c6-8c45-4b71-82d6-cabc06d8fa36 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.614859 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e15a86c6-8c45-4b71-82d6-cabc06d8fa36 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.625089 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e15a86c6-8c45-4b71-82d6-cabc06d8fa36 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.625814 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e15a86c6-8c45-4b71-82d6-cabc06d8fa36 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.929765 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:41.966041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:41.985302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:41.988128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-20dcca68-e7fd-4fc0-a2e4-a861220c4d78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.486742 Dec 16 14:41:41.989566 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 235/449] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:41 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:42.173528 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e15a86c6-8c45-4b71-82d6-cabc06d8fa36 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:42.188653 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e15a86c6-8c45-4b71-82d6-cabc06d8fa36 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.610225 Dec 16 14:41:42.198134 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 215/450] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:41 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:42.512198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-65ab81c3-9be0-44bc-a3ae-3835b237b0b6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:42.513335 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-65ab81c3-9be0-44bc-a3ae-3835b237b0b6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:42.527672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65ab81c3-9be0-44bc-a3ae-3835b237b0b6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.528536 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65ab81c3-9be0-44bc-a3ae-3835b237b0b6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:42.530376 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65ab81c3-9be0-44bc-a3ae-3835b237b0b6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.531188 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-65ab81c3-9be0-44bc-a3ae-3835b237b0b6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.030487 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:43.032335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:43.053582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:43.056085 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.058847 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:43.059798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.076344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-65ab81c3-9be0-44bc-a3ae-3835b237b0b6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:43.096054 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-65ab81c3-9be0-44bc-a3ae-3835b237b0b6 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.605664 Dec 16 14:41:43.110827 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 236/451] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:42 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:43.235656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-dfb17510-0aab-4292-804e-59dfb8d882a5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:43.236317 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-dfb17510-0aab-4292-804e-59dfb8d882a5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:43.252527 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dfb17510-0aab-4292-804e-59dfb8d882a5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:43.253154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dfb17510-0aab-4292-804e-59dfb8d882a5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.264791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dfb17510-0aab-4292-804e-59dfb8d882a5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:43.265221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dfb17510-0aab-4292-804e-59dfb8d882a5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.676046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:43.699886 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:43.713146 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:43.715751 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-924b9924-f739-4ea7-a55c-23b5644dd30d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.709265 Dec 16 14:41:43.733311 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 216/452] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:43 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:43.821150 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-dfb17510-0aab-4292-804e-59dfb8d882a5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:43.847887 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-dfb17510-0aab-4292-804e-59dfb8d882a5 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.638916 Dec 16 14:41:43.852063 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 237/453] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:43 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:44.152321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f8550389-4d35-4b57-a9fa-e6d5bba494dc tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:44.155689 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f8550389-4d35-4b57-a9fa-e6d5bba494dc tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:44.186088 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f8550389-4d35-4b57-a9fa-e6d5bba494dc tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.188110 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f8550389-4d35-4b57-a9fa-e6d5bba494dc tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.189909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f8550389-4d35-4b57-a9fa-e6d5bba494dc tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.191039 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f8550389-4d35-4b57-a9fa-e6d5bba494dc tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.698245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f8550389-4d35-4b57-a9fa-e6d5bba494dc tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:44.713139 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f8550389-4d35-4b57-a9fa-e6d5bba494dc tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.598684 Dec 16 14:41:44.714692 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 217/454] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:44 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:44.751637 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:44.752257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:44.765737 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.766460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.767703 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.768359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.898332 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-570373e1-3a85-4e8f-81e1-88810e71b8b8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:44.899417 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-570373e1-3a85-4e8f-81e1-88810e71b8b8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:44.922505 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570373e1-3a85-4e8f-81e1-88810e71b8b8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.923335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570373e1-3a85-4e8f-81e1-88810e71b8b8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.924881 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570373e1-3a85-4e8f-81e1-88810e71b8b8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.925683 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570373e1-3a85-4e8f-81e1-88810e71b8b8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:45.216506 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:45.246294 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:45.254994 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:45.256998 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f7461c1d-f34e-4519-86c0-3a63ea039cab tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.518662 Dec 16 14:41:45.258423 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 238/455] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:44 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:45.417711 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-570373e1-3a85-4e8f-81e1-88810e71b8b8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:45.436453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-570373e1-3a85-4e8f-81e1-88810e71b8b8 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.554776 Dec 16 14:41:45.437924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 218/456] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:44 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:45.750741 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-03fc32b4-a730-44fe-92d0-9f8e6c944338 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:45.751711 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-03fc32b4-a730-44fe-92d0-9f8e6c944338 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:45.770350 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-03fc32b4-a730-44fe-92d0-9f8e6c944338 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:45.771707 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-03fc32b4-a730-44fe-92d0-9f8e6c944338 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:45.772885 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-03fc32b4-a730-44fe-92d0-9f8e6c944338 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:45.774951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-03fc32b4-a730-44fe-92d0-9f8e6c944338 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.181017 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-03fc32b4-a730-44fe-92d0-9f8e6c944338 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:46.206203 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-03fc32b4-a730-44fe-92d0-9f8e6c944338 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.471808 Dec 16 14:41:46.207853 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 239/457] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:45 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:46.304171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:46.306270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:46.320031 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.321653 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.323080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.323820 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.483990 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0fa5e7ea-ce60-4720-b264-b6afdaf7993e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:46.486099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0fa5e7ea-ce60-4720-b264-b6afdaf7993e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:46.510084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0fa5e7ea-ce60-4720-b264-b6afdaf7993e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.510084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0fa5e7ea-ce60-4720-b264-b6afdaf7993e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.510084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0fa5e7ea-ce60-4720-b264-b6afdaf7993e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.510084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0fa5e7ea-ce60-4720-b264-b6afdaf7993e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.740003 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:46.768576 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:46.779866 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:46.782116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-33844df7-5e55-4f9b-8597-dec825127615 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.498344 Dec 16 14:41:46.783059 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 219/458] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:46 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:46.888948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0fa5e7ea-ce60-4720-b264-b6afdaf7993e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:46.897739 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0fa5e7ea-ce60-4720-b264-b6afdaf7993e tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.435004 Dec 16 14:41:46.898931 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 240/459] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:46 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:47.240065 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-95f276ff-dc9f-4104-8a97-7a700b222c8a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:47.240743 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-95f276ff-dc9f-4104-8a97-7a700b222c8a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:47.250207 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-95f276ff-dc9f-4104-8a97-7a700b222c8a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.250659 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-95f276ff-dc9f-4104-8a97-7a700b222c8a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.251466 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-95f276ff-dc9f-4104-8a97-7a700b222c8a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.251952 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-95f276ff-dc9f-4104-8a97-7a700b222c8a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.677116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-95f276ff-dc9f-4104-8a97-7a700b222c8a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:47.690795 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-95f276ff-dc9f-4104-8a97-7a700b222c8a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.461509 Dec 16 14:41:47.691699 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 220/460] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:47 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:47.818321 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:47.819140 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:47.831287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.831767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.833012 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.833489 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.925787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-66e5f0d6-8d05-486f-9bf2-b558a6996949 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:47.926638 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-66e5f0d6-8d05-486f-9bf2-b558a6996949 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:47.935991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66e5f0d6-8d05-486f-9bf2-b558a6996949 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.936598 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66e5f0d6-8d05-486f-9bf2-b558a6996949 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.937710 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66e5f0d6-8d05-486f-9bf2-b558a6996949 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.938682 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66e5f0d6-8d05-486f-9bf2-b558a6996949 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:48.169870 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:48.188279 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:48.196310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:48.197705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f048d195-04ed-47d1-9311-63cf754c3951 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.394463 Dec 16 14:41:48.198417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 241/461] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:47 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:48.257704 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-66e5f0d6-8d05-486f-9bf2-b558a6996949 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:48.268094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-66e5f0d6-8d05-486f-9bf2-b558a6996949 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.352299 Dec 16 14:41:48.269391 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 221/462] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:47 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:48.725296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8b28a58a-b7ae-4c3e-9810-bd7de5ef8238 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:48.726957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8b28a58a-b7ae-4c3e-9810-bd7de5ef8238 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:48.736125 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b28a58a-b7ae-4c3e-9810-bd7de5ef8238 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:48.736923 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b28a58a-b7ae-4c3e-9810-bd7de5ef8238 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:48.738368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b28a58a-b7ae-4c3e-9810-bd7de5ef8238 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:48.739071 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b28a58a-b7ae-4c3e-9810-bd7de5ef8238 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.075915 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8b28a58a-b7ae-4c3e-9810-bd7de5ef8238 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:49.085153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8b28a58a-b7ae-4c3e-9810-bd7de5ef8238 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1502 microversion: 2.1 time: 0.373268 Dec 16 14:41:49.085959 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 242/463] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:48 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1502 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:49.114165 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9ba55593-a3a5-4b1d-a334-c4e8d37efc81 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5121b16-03fe-438d-877b-2dae3577f76d"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:49.115540 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9ba55593-a3a5-4b1d-a334-c4e8d37efc81 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:49.124458 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ba55593-a3a5-4b1d-a334-c4e8d37efc81 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.125108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ba55593-a3a5-4b1d-a334-c4e8d37efc81 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.126203 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ba55593-a3a5-4b1d-a334-c4e8d37efc81 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.126659 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ba55593-a3a5-4b1d-a334-c4e8d37efc81 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.212132 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-9ba55593-a3a5-4b1d-a334-c4e8d37efc81 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] HTTP exception thrown: Cannot 'attach_volume' instance 618e7310-603e-4003-b2d6-b05eb18cd558 while it is in vm_state rescued Dec 16 14:41:49.213171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9ba55593-a3a5-4b1d-a334-c4e8d37efc81 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Returning 409 to user: Cannot 'attach_volume' instance 618e7310-603e-4003-b2d6-b05eb18cd558 while it is in vm_state rescued {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:41:49.214492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9ba55593-a3a5-4b1d-a334-c4e8d37efc81 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.113974 Dec 16 14:41:49.216109 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 222/464] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:41:49 2021] POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 14:41:49.232743 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:49.234091 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:49.235230 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5a1c30aa-837f-419c-a312-d5d320870168 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:49.235768 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5a1c30aa-837f-419c-a312-d5d320870168 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:49.246438 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5a1c30aa-837f-419c-a312-d5d320870168 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.246933 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5a1c30aa-837f-419c-a312-d5d320870168 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.247445 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.247954 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5a1c30aa-837f-419c-a312-d5d320870168 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.248366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.248479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5a1c30aa-837f-419c-a312-d5d320870168 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.251697 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.253012 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.549305 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5a1c30aa-837f-419c-a312-d5d320870168 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/action" status: 202 len: 0 microversion: 2.1 time: 0.325353 Dec 16 14:41:49.558247 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 223/465] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:41:49 2021] POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:41:49.576212 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-41e503bf-f016-466c-886c-e34a899581f0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:49.577477 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-41e503bf-f016-466c-886c-e34a899581f0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:49.590588 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41e503bf-f016-466c-886c-e34a899581f0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.591960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41e503bf-f016-466c-886c-e34a899581f0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.593417 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41e503bf-f016-466c-886c-e34a899581f0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.594546 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41e503bf-f016-466c-886c-e34a899581f0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.624240 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:49.660957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:49.672909 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:49.675555 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-159f0afa-6d5c-4b21-9e94-6a5a2978f541 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1739 microversion: 2.20 time: 0.461398 Dec 16 14:41:49.677198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 243/466] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:49 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1739 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:49.693516 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4ce4f5bd-2f01-4320-86fd-33574edbe484 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:49.695296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4ce4f5bd-2f01-4320-86fd-33574edbe484 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:49.707177 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4ce4f5bd-2f01-4320-86fd-33574edbe484 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.707807 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4ce4f5bd-2f01-4320-86fd-33574edbe484 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.709232 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4ce4f5bd-2f01-4320-86fd-33574edbe484 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.710419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4ce4f5bd-2f01-4320-86fd-33574edbe484 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:50.160156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4ce4f5bd-2f01-4320-86fd-33574edbe484 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:50.190151 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4ce4f5bd-2f01-4320-86fd-33574edbe484 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1510 microversion: 2.1 time: 0.511256 Dec 16 14:41:50.203051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 244/467] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:49 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:50.272498 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-41e503bf-f016-466c-886c-e34a899581f0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:50.331949 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-41e503bf-f016-466c-886c-e34a899581f0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.751613 Dec 16 14:41:50.332989 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 224/468] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:49 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:50.718694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:50.719372 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:50.733129 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.734010 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:50.737205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.738023 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.021350 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:51.042599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:51.051807 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:51.053383 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-20630cef-9b4e-4932-9c27-998d12172bd9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1721 microversion: 2.20 time: 0.348275 Dec 16 14:41:51.054082 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 245/469] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:50 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1721 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:51.241176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8156bf37-4cb9-4024-94b5-963031e61292 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:51.243756 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8156bf37-4cb9-4024-94b5-963031e61292 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:51.259500 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8156bf37-4cb9-4024-94b5-963031e61292 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:51.260534 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8156bf37-4cb9-4024-94b5-963031e61292 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.262459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8156bf37-4cb9-4024-94b5-963031e61292 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:51.263523 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8156bf37-4cb9-4024-94b5-963031e61292 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.360094 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-10ad27c2-8abb-4594-834a-10c6c2e3c7a1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:51.361081 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-10ad27c2-8abb-4594-834a-10c6c2e3c7a1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:51.369541 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-10ad27c2-8abb-4594-834a-10c6c2e3c7a1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:51.370119 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-10ad27c2-8abb-4594-834a-10c6c2e3c7a1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.371036 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-10ad27c2-8abb-4594-834a-10c6c2e3c7a1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:51.371632 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-10ad27c2-8abb-4594-834a-10c6c2e3c7a1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.632703 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8156bf37-4cb9-4024-94b5-963031e61292 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:51.644736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8156bf37-4cb9-4024-94b5-963031e61292 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1510 microversion: 2.1 time: 0.424215 Dec 16 14:41:51.645797 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 225/470] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:51 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1510 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:51.717160 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-10ad27c2-8abb-4594-834a-10c6c2e3c7a1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:51.728793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-10ad27c2-8abb-4594-834a-10c6c2e3c7a1 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.381198 Dec 16 14:41:51.729460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 246/471] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:51 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:52.092290 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:52.093066 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:52.106593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.107797 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.109405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.110292 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.416240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:52.432991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:52.440702 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:52.441967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3a673ecd-eaf5-44c3-ac37-fc420475f18f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1721 microversion: 2.20 time: 0.361168 Dec 16 14:41:52.442726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 226/472] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:52 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:52.689599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0f96feaf-96f6-4484-872b-3be19420eb66 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:52.690725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0f96feaf-96f6-4484-872b-3be19420eb66 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:52.705045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f96feaf-96f6-4484-872b-3be19420eb66 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.705780 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f96feaf-96f6-4484-872b-3be19420eb66 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.707206 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f96feaf-96f6-4484-872b-3be19420eb66 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.708020 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f96feaf-96f6-4484-872b-3be19420eb66 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.756398 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2399ea99-4254-437a-9213-7af665cd27ee tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:52.757166 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2399ea99-4254-437a-9213-7af665cd27ee tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:52.766792 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2399ea99-4254-437a-9213-7af665cd27ee tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.767255 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2399ea99-4254-437a-9213-7af665cd27ee tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.768349 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2399ea99-4254-437a-9213-7af665cd27ee tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.768828 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2399ea99-4254-437a-9213-7af665cd27ee tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:53.063617 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2399ea99-4254-437a-9213-7af665cd27ee tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:53.077648 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2399ea99-4254-437a-9213-7af665cd27ee tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.334712 Dec 16 14:41:53.078741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 227/473] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:52 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:53.085939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0f96feaf-96f6-4484-872b-3be19420eb66 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:53.095117 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0f96feaf-96f6-4484-872b-3be19420eb66 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1510 microversion: 2.1 time: 0.425507 Dec 16 14:41:53.095712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 247/474] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:52 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1510 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:53.473595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:53.474214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:53.483555 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:53.484036 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:53.484990 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:53.485464 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:53.753118 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:53.772291 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:53.779488 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:53.780627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c8364582-029c-4fbd-ac76-4549d9f85160 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1721 microversion: 2.20 time: 0.321540 Dec 16 14:41:53.781176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 228/475] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:53 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:54.114725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e87122f2-b78c-4700-8f1b-efcefd450eb4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:54.115995 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e87122f2-b78c-4700-8f1b-efcefd450eb4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:54.123132 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-77d56fc5-8b46-4f4d-914d-9a04cba73ec9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:54.124007 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-77d56fc5-8b46-4f4d-914d-9a04cba73ec9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:54.131278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e87122f2-b78c-4700-8f1b-efcefd450eb4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.132178 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e87122f2-b78c-4700-8f1b-efcefd450eb4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.133761 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e87122f2-b78c-4700-8f1b-efcefd450eb4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.134673 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e87122f2-b78c-4700-8f1b-efcefd450eb4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.135249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77d56fc5-8b46-4f4d-914d-9a04cba73ec9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.136023 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77d56fc5-8b46-4f4d-914d-9a04cba73ec9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.137302 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77d56fc5-8b46-4f4d-914d-9a04cba73ec9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.137865 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77d56fc5-8b46-4f4d-914d-9a04cba73ec9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.436221 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-77d56fc5-8b46-4f4d-914d-9a04cba73ec9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:54.449079 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-77d56fc5-8b46-4f4d-914d-9a04cba73ec9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1510 microversion: 2.1 time: 0.339353 Dec 16 14:41:54.450521 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 229/476] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:54 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:54.494730 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e87122f2-b78c-4700-8f1b-efcefd450eb4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:54.508140 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e87122f2-b78c-4700-8f1b-efcefd450eb4 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.413249 Dec 16 14:41:54.509078 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 248/477] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:54 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:54.816243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:54.817366 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:54.832227 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.833045 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.834556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.835329 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.207743 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-6cbea7f6-be01-469d-8614-e26cf57af789 req-6ea84618-071f-4a2c-b0e9-4e7c2b21ee82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b5c02-69ca-4290-bba0-54d6ed2eb215", "name": "network-vif-unplugged", "status": "completed", "tag": "e59517d2-2291-4c73-889e-594d9cc076e2"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:55.251501 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:55.251501 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:41:55.288697 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-6cbea7f6-be01-469d-8614-e26cf57af789 req-6ea84618-071f-4a2c-b0e9-4e7c2b21ee82 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.295539 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-6cbea7f6-be01-469d-8614-e26cf57af789 req-6ea84618-071f-4a2c-b0e9-4e7c2b21ee82 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.370043 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-6cbea7f6-be01-469d-8614-e26cf57af789 req-6ea84618-071f-4a2c-b0e9-4e7c2b21ee82 service nova] Creating event network-vif-unplugged:e59517d2-2291-4c73-889e-594d9cc076e2 for instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 on hv-cinder-82189 Dec 16 14:41:55.385329 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-6cbea7f6-be01-469d-8614-e26cf57af789 req-6ea84618-071f-4a2c-b0e9-4e7c2b21ee82 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.224008 Dec 16 14:41:55.387029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 249/478] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:55.481677 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-35f42d04-c27a-4b52-b639-0f612fbdf47d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:55.483255 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-35f42d04-c27a-4b52-b639-0f612fbdf47d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:55.499800 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-35f42d04-c27a-4b52-b639-0f612fbdf47d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.500819 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-35f42d04-c27a-4b52-b639-0f612fbdf47d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.503247 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-35f42d04-c27a-4b52-b639-0f612fbdf47d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.503954 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-35f42d04-c27a-4b52-b639-0f612fbdf47d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.690412 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:55.709192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:55.716556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:55.717722 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7b1fe66a-f5d4-4f14-99bf-9d7d9f632e64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1721 microversion: 2.20 time: 0.921673 Dec 16 14:41:55.718307 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 230/479] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:54 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1721 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:55.730264 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e7fcacf1-2ba4-4091-8cd1-270f077fcdc0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:55.731084 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e7fcacf1-2ba4-4091-8cd1-270f077fcdc0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:55.742421 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e7fcacf1-2ba4-4091-8cd1-270f077fcdc0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.743657 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e7fcacf1-2ba4-4091-8cd1-270f077fcdc0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.744541 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e7fcacf1-2ba4-4091-8cd1-270f077fcdc0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.744978 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e7fcacf1-2ba4-4091-8cd1-270f077fcdc0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.908724 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-35f42d04-c27a-4b52-b639-0f612fbdf47d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:55.940394 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-35f42d04-c27a-4b52-b639-0f612fbdf47d tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1510 microversion: 2.1 time: 0.474711 Dec 16 14:41:55.959018 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 250/480] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:55 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1510 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:56.110956 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e7fcacf1-2ba4-4091-8cd1-270f077fcdc0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:56.137081 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e7fcacf1-2ba4-4091-8cd1-270f077fcdc0 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1503 microversion: 2.1 time: 0.417260 Dec 16 14:41:56.138874 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 231/481] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:55 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1503 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:56.747549 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:56.748187 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:56.764111 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.764892 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:56.765687 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.766367 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:56.972958 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-588064a2-d336-4387-a8d0-3553232a011e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:56.973594 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-588064a2-d336-4387-a8d0-3553232a011e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:56.983308 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-588064a2-d336-4387-a8d0-3553232a011e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.984145 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-588064a2-d336-4387-a8d0-3553232a011e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:56.985226 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-588064a2-d336-4387-a8d0-3553232a011e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.985899 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-588064a2-d336-4387-a8d0-3553232a011e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:57.364384 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-588064a2-d336-4387-a8d0-3553232a011e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:57.395599 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-588064a2-d336-4387-a8d0-3553232a011e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1510 microversion: 2.1 time: 0.434060 Dec 16 14:41:57.400032 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 232/482] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:56 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:57.431796 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-26e29cd3-9480-4092-b175-16fe31216e40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:57.433041 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-26e29cd3-9480-4092-b175-16fe31216e40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:57.443593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-26e29cd3-9480-4092-b175-16fe31216e40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:57.444744 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-26e29cd3-9480-4092-b175-16fe31216e40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:57.446189 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-26e29cd3-9480-4092-b175-16fe31216e40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:57.446976 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-26e29cd3-9480-4092-b175-16fe31216e40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:57.646319 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-26e29cd3-9480-4092-b175-16fe31216e40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:57.659596 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-26e29cd3-9480-4092-b175-16fe31216e40 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1461 microversion: 2.1 time: 0.251227 Dec 16 14:41:57.660584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 233/483] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:57 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1461 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:57.710800 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-b5e12cf5-fc08-488f-8472-8553ccfe9e32 req-569b4a8f-fe69-40cb-af74-ece7ffbad98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c28e5c9-7dd1-493d-a812-10367a49ad01", "name": "network-vif-deleted", "tag": "11b0cec4-410e-43d4-a952-a07f61931613"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:57.727283 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:57.727283 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:41:57.744730 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-b5e12cf5-fc08-488f-8472-8553ccfe9e32 req-569b4a8f-fe69-40cb-af74-ece7ffbad98d service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:57.747051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-b5e12cf5-fc08-488f-8472-8553ccfe9e32 req-569b4a8f-fe69-40cb-af74-ece7ffbad98d service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:57.787105 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-b5e12cf5-fc08-488f-8472-8553ccfe9e32 req-569b4a8f-fe69-40cb-af74-ece7ffbad98d service nova] Creating event network-vif-deleted:11b0cec4-410e-43d4-a952-a07f61931613 for instance 0c28e5c9-7dd1-493d-a812-10367a49ad01 on hv-cinder-82189 Dec 16 14:41:57.799432 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-b5e12cf5-fc08-488f-8472-8553ccfe9e32 req-569b4a8f-fe69-40cb-af74-ece7ffbad98d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107535 Dec 16 14:41:57.806473 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 234/484] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:41:57.846622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:57.869173 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:57.880204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:57.882027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8e9ce459-e47a-454a-8ebc-6dee81a257bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1721 microversion: 2.20 time: 1.146874 Dec 16 14:41:57.883427 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 251/485] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:56 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1721 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:58.465686 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-138d6a0c-b66e-4098-ac79-60f87ba59708 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:58.468021 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-138d6a0c-b66e-4098-ac79-60f87ba59708 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:58.483437 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-138d6a0c-b66e-4098-ac79-60f87ba59708 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.484641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-138d6a0c-b66e-4098-ac79-60f87ba59708 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.486453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-138d6a0c-b66e-4098-ac79-60f87ba59708 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.491472 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-138d6a0c-b66e-4098-ac79-60f87ba59708 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.700513 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:58.701506 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:58.711639 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.713500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.714712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.715294 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.816849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-138d6a0c-b66e-4098-ac79-60f87ba59708 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:58.829193 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-138d6a0c-b66e-4098-ac79-60f87ba59708 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1510 microversion: 2.1 time: 0.396550 Dec 16 14:41:58.834042 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 235/486] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:58 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:58.835394 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.835947 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.836902 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lazy-loading 'fault' on Instance uuid 0c28e5c9-7dd1-493d-a812-10367a49ad01 {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:41:58.920322 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:58.921758 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:58.934249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.934249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.934249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.934665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.984349 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f642c76a379d43fe97078fb43b7477dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755abf4383dc4d3ca3ec465e631d8684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:58.994585 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d9b2f70a-af30-439b-9762-fe1c4e3dc649 tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 200 len: 1304 microversion: 2.1 time: 0.309485 Dec 16 14:41:58.995533 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 252/487] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:58 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 1304 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:59.202803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:59.218267 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:59.224865 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:41:59.226146 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-278f58b1-39d6-4e42-91e3-dd1d1457c8e9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1724 microversion: 2.20 time: 0.321371 Dec 16 14:41:59.226690 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 236/488] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:58 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:59.251917 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f1ad64cf-5cc5-4a43-8398-e4d079b06119 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efe970c2-bc00-4a68-8b8b-ee71c566e919"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:59.253054 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f1ad64cf-5cc5-4a43-8398-e4d079b06119 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:59.263510 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1ad64cf-5cc5-4a43-8398-e4d079b06119 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.263945 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1ad64cf-5cc5-4a43-8398-e4d079b06119 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:59.264758 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1ad64cf-5cc5-4a43-8398-e4d079b06119 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.265183 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f1ad64cf-5cc5-4a43-8398-e4d079b06119 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:59.864303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e24c2d04-5657-4dc8-956a-74461c4ede13 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:59.871030 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e24c2d04-5657-4dc8-956a-74461c4ede13 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:41:59.887742 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e24c2d04-5657-4dc8-956a-74461c4ede13 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.890838 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e24c2d04-5657-4dc8-956a-74461c4ede13 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:59.892124 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e24c2d04-5657-4dc8-956a-74461c4ede13 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.895574 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e24c2d04-5657-4dc8-956a-74461c4ede13 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.198153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f1ad64cf-5cc5-4a43-8398-e4d079b06119 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.954680 Dec 16 14:42:00.199489 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 253/489] 10.222.0.67 () {62 vars in 1363 bytes} [Thu Dec 16 14:41:59 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 188 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:42:00.226288 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-47938684", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-110580736", "security_groups": [{"name": "tempest-secgroup-smoke-871228871"}], "networks": [{"uuid": "aad28f85-671a-4b76-9701-bffd022aa1bd"}], "block_device_mapping_v2": [{"uuid": "27edf176-7cd7-4433-bbaa-efc7ec184755", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:00.373279 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e24c2d04-5657-4dc8-956a-74461c4ede13 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:00.387101 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e24c2d04-5657-4dc8-956a-74461c4ede13 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1510 microversion: 2.1 time: 0.539617 Dec 16 14:42:00.394506 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 237/490] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:59 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1510 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:00.413952 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cce73d1b-e19e-4853-8dfa-7ad3a8be0adc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:00.415969 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cce73d1b-e19e-4853-8dfa-7ad3a8be0adc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] [instance: 0c28e5c9-7dd1-493d-a812-10367a49ad01] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:00.429382 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cce73d1b-e19e-4853-8dfa-7ad3a8be0adc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.430249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cce73d1b-e19e-4853-8dfa-7ad3a8be0adc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.431928 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cce73d1b-e19e-4853-8dfa-7ad3a8be0adc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.432746 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cce73d1b-e19e-4853-8dfa-7ad3a8be0adc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.529924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-cce73d1b-e19e-4853-8dfa-7ad3a8be0adc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] HTTP exception thrown: Instance 0c28e5c9-7dd1-493d-a812-10367a49ad01 could not be found. Dec 16 14:42:00.531325 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cce73d1b-e19e-4853-8dfa-7ad3a8be0adc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] Returning 404 to user: Instance 0c28e5c9-7dd1-493d-a812-10367a49ad01 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:42:00.532210 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cce73d1b-e19e-4853-8dfa-7ad3a8be0adc tempest-VolumesActionsTest-1951852526 tempest-VolumesActionsTest-1951852526-project] 10.222.0.67 "GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01" status: 404 len: 111 microversion: 2.1 time: 0.138779 Dec 16 14:42:00.532800 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 238/491] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:00 2021] GET /compute/v2.1/servers/0c28e5c9-7dd1-493d-a812-10367a49ad01 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:00.645928 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-77433a84-bf51-4a06-a89d-b29c6ab63a43 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:00.646769 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-77433a84-bf51-4a06-a89d-b29c6ab63a43 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:00.658498 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77433a84-bf51-4a06-a89d-b29c6ab63a43 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.659051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77433a84-bf51-4a06-a89d-b29c6ab63a43 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.662068 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.network.neutron [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] validate_networks() for [('aad28f85-671a-4b76-9701-bffd022aa1bd', None, None, None)] {{(pid=96670) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:42:00.662718 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77433a84-bf51-4a06-a89d-b29c6ab63a43 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.663653 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77433a84-bf51-4a06-a89d-b29c6ab63a43 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.163688 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-77433a84-bf51-4a06-a89d-b29c6ab63a43 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action" status: 202 len: 0 microversion: 2.20 time: 0.532615 Dec 16 14:42:01.167228 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 239/492] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:42:00 2021] POST /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:42:01.199262 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:01.200259 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:01.212429 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.213517 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.214470 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.215117 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.691141 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:01.722042 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:01.740154 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:01.743631 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9bf46524-8dd5-422a-ae6e-b5ccf68f5ee1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1750 microversion: 2.20 time: 0.571227 Dec 16 14:42:01.764012 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 240/493] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:01 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1750 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:01.776496 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-69267984-5e98-4e26-828b-e2a80d37c391 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:01.777637 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-69267984-5e98-4e26-828b-e2a80d37c391 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:01.789739 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69267984-5e98-4e26-828b-e2a80d37c391 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.790948 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69267984-5e98-4e26-828b-e2a80d37c391 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.791528 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69267984-5e98-4e26-828b-e2a80d37c391 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.792043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69267984-5e98-4e26-828b-e2a80d37c391 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.913120 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Flavor limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:42:01.915286 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Image limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:42:01.916380 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Flavor pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:42:01.917214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Image pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:42:01.918093 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:42:01.931153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.932155 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.934237 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.935278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.998153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Getting quotas for project 9a687d83941a46d8893bb58f302b2951. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:42:02.009421 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Getting quotas for user 60acaee6050143099c2ded8515eab3d3 and project 9a687d83941a46d8893bb58f302b2951. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:42:02.224441 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-69267984-5e98-4e26-828b-e2a80d37c391 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:02.251005 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-69267984-5e98-4e26-828b-e2a80d37c391 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1516 microversion: 2.1 time: 0.483891 Dec 16 14:42:02.251641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 241/494] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:01 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1516 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:02.308309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Going to run 1 instances... {{(pid=96670) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:42:02.316761 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27edf176-7cd7-4433-bbaa-efc7ec184755',volume_size=None,volume_type=None)] {{(pid=96670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:42:02.790931 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:02.792019 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:02.803029 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:02.803453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:02.804658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:02.805337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:03.095643 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1ad434e8-af27-4a3b-99db-aca20629e27a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.894066 Dec 16 14:42:03.097726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 254/495] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:42:00 2021] POST /compute/v2.1/servers => generated 405 bytes in 2897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:42:03.163088 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-88f0e26f-af4f-45b8-9296-0b2bced1fee9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:03.164468 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-88f0e26f-af4f-45b8-9296-0b2bced1fee9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:03.343988 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-88f0e26f-af4f-45b8-9296-0b2bced1fee9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:03.363436 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:03.376023 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-88f0e26f-af4f-45b8-9296-0b2bced1fee9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1086 microversion: 2.1 time: 0.264938 Dec 16 14:42:03.398032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 255/496] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:03 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1086 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:03.422121 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:03.438328 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:03.441100 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1fd4691c-2320-474c-b591-09b0dba32984 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1750 microversion: 2.20 time: 0.667322 Dec 16 14:42:03.442329 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 242/497] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:02 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1750 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:04.427123 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7983f12a-0dad-484a-b081-8b6026637734 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:04.429502 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7983f12a-0dad-484a-b081-8b6026637734 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:04.451949 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7983f12a-0dad-484a-b081-8b6026637734 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.454007 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7983f12a-0dad-484a-b081-8b6026637734 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.457092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7983f12a-0dad-484a-b081-8b6026637734 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.463467 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7983f12a-0dad-484a-b081-8b6026637734 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.484686 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:04.486667 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:04.497771 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.498394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.499488 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.500066 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.738820 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7983f12a-0dad-484a-b081-8b6026637734 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:04.748400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7983f12a-0dad-484a-b081-8b6026637734 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1184 microversion: 2.1 time: 0.340963 Dec 16 14:42:04.749579 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 256/498] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:04 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1184 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:04.760402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f494e3b2-442d-4697-8487-2653bcaf45a9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:04.761448 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f494e3b2-442d-4697-8487-2653bcaf45a9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:04.781844 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f494e3b2-442d-4697-8487-2653bcaf45a9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.782660 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f494e3b2-442d-4697-8487-2653bcaf45a9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.783686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f494e3b2-442d-4697-8487-2653bcaf45a9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.784283 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f494e3b2-442d-4697-8487-2653bcaf45a9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.890951 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:04.922995 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:04.930944 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:04.932628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-570319dc-7e80-43d3-8e48-8884eedb1c0f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1752 microversion: 2.20 time: 0.468334 Dec 16 14:42:04.933410 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 243/499] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:04 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1752 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:05.192856 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f494e3b2-442d-4697-8487-2653bcaf45a9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:05.209445 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f494e3b2-442d-4697-8487-2653bcaf45a9 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1516 microversion: 2.1 time: 0.458148 Dec 16 14:42:05.210484 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 257/500] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:04 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1516 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:05.250761 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-dd5f8cb2-22e3-4371-ac73-d32fc37361f3 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7656ae02-9c74-4768-be6f-b3637280a988"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:05.252415 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-dd5f8cb2-22e3-4371-ac73-d32fc37361f3 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:05.265544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dd5f8cb2-22e3-4371-ac73-d32fc37361f3 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.266319 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dd5f8cb2-22e3-4371-ac73-d32fc37361f3 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.267587 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dd5f8cb2-22e3-4371-ac73-d32fc37361f3 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.268250 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dd5f8cb2-22e3-4371-ac73-d32fc37361f3 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.792732 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b6fa3fa6-c5a0-419b-a65c-ff0740bf0ff6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:05.794942 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b6fa3fa6-c5a0-419b-a65c-ff0740bf0ff6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:05.809620 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b6fa3fa6-c5a0-419b-a65c-ff0740bf0ff6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.810839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b6fa3fa6-c5a0-419b-a65c-ff0740bf0ff6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.812292 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b6fa3fa6-c5a0-419b-a65c-ff0740bf0ff6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.813325 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b6fa3fa6-c5a0-419b-a65c-ff0740bf0ff6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.014234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b6fa3fa6-c5a0-419b-a65c-ff0740bf0ff6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:06.033082 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b6fa3fa6-c5a0-419b-a65c-ff0740bf0ff6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1202 microversion: 2.1 time: 0.259259 Dec 16 14:42:06.034725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 258/501] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:05 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1202 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:06.057842 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:06.059176 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:06.073849 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.074662 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.076198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.076980 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.483954 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:06.501375 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:06.509046 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:06.510627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d2478e8f-1acd-4484-b657-392a33803aaf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1752 microversion: 2.20 time: 0.473511 Dec 16 14:42:06.511805 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 259/502] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:06 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1752 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:07.069355 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c6b49482-bf9a-4d23-bc6a-b0da7e68a8ee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:07.070423 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c6b49482-bf9a-4d23-bc6a-b0da7e68a8ee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:07.083363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6b49482-bf9a-4d23-bc6a-b0da7e68a8ee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.084113 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6b49482-bf9a-4d23-bc6a-b0da7e68a8ee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.085483 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6b49482-bf9a-4d23-bc6a-b0da7e68a8ee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.086212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6b49482-bf9a-4d23-bc6a-b0da7e68a8ee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.283803 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c6b49482-bf9a-4d23-bc6a-b0da7e68a8ee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:07.294167 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c6b49482-bf9a-4d23-bc6a-b0da7e68a8ee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1202 microversion: 2.1 time: 0.241550 Dec 16 14:42:07.298948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 260/503] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:07 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1202 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:07.548350 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:07.549465 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:07.563049 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.563772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.564984 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.565675 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.868055 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:07.895200 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:07.908123 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:07.909732 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9c5cd7b4-c413-4d52-a718-a719ae3c6830 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1752 microversion: 2.20 time: 0.382066 Dec 16 14:42:07.910751 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 261/504] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:07 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1752 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:08.318371 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e6c99d3d-3d29-41ec-bce9-925f0d55f236 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:08.319300 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e6c99d3d-3d29-41ec-bce9-925f0d55f236 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:08.328062 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e6c99d3d-3d29-41ec-bce9-925f0d55f236 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.328607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e6c99d3d-3d29-41ec-bce9-925f0d55f236 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.329459 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e6c99d3d-3d29-41ec-bce9-925f0d55f236 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.329888 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e6c99d3d-3d29-41ec-bce9-925f0d55f236 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.492669 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e6c99d3d-3d29-41ec-bce9-925f0d55f236 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:08.502364 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e6c99d3d-3d29-41ec-bce9-925f0d55f236 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1202 microversion: 2.1 time: 0.193716 Dec 16 14:42:08.502929 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 262/505] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:08 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1202 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:08.973566 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:08.975303 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:09.007863 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.008666 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.010621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.011505 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.374745 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-dd5f8cb2-22e3-4371-ac73-d32fc37361f3 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.141245 Dec 16 14:42:09.375967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 244/506] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:42:05 2021] POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments => generated 194 bytes in 4144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:09.536804 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-be049adf-49c2-4116-b0bc-f6373c342568 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:09.537644 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-be049adf-49c2-4116-b0bc-f6373c342568 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:09.550389 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be049adf-49c2-4116-b0bc-f6373c342568 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.550934 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be049adf-49c2-4116-b0bc-f6373c342568 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.553003 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be049adf-49c2-4116-b0bc-f6373c342568 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.554805 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be049adf-49c2-4116-b0bc-f6373c342568 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.759246 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:09.798927 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:09.808021 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:09.809328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cc63689c-33fc-4431-8ee4-e61945b39217 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1752 microversion: 2.20 time: 0.880425 Dec 16 14:42:09.809828 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 263/507] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:08 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1752 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:09.827372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-be049adf-49c2-4116-b0bc-f6373c342568 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:09.845921 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-be049adf-49c2-4116-b0bc-f6373c342568 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1202 microversion: 2.1 time: 0.321692 Dec 16 14:42:09.859506 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 245/508] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:09 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1202 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:10.862772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:10.863449 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:10.882527 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:10.886039 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:10.886884 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:10.887319 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:10.908796 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1bd30517-2785-4ff3-b72d-e9ff52630c57 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:10.909607 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1bd30517-2785-4ff3-b72d-e9ff52630c57 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:10.930316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bd30517-2785-4ff3-b72d-e9ff52630c57 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:10.930778 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bd30517-2785-4ff3-b72d-e9ff52630c57 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:10.931902 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bd30517-2785-4ff3-b72d-e9ff52630c57 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:10.932604 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bd30517-2785-4ff3-b72d-e9ff52630c57 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.723954 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:11.792883 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:11.840778 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:11.842666 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b712174a-7c1f-4a90-a5de-6b9b035c8c61 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 1.009388 Dec 16 14:42:11.864157 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 264/509] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:10 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:12.054382 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1bd30517-2785-4ff3-b72d-e9ff52630c57 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:12.076546 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1bd30517-2785-4ff3-b72d-e9ff52630c57 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1269 microversion: 2.1 time: 1.206596 Dec 16 14:42:12.078855 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 246/510] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:10 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1269 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:12.897521 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:12.907122 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:12.951024 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:12.951802 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:12.959527 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:12.962465 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.155480 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4162b1bc-c6af-41c6-b010-0d01388812be tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:13.166533 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4162b1bc-c6af-41c6-b010-0d01388812be tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:13.230203 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4162b1bc-c6af-41c6-b010-0d01388812be tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.239014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4162b1bc-c6af-41c6-b010-0d01388812be tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.244802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4162b1bc-c6af-41c6-b010-0d01388812be tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.256302 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4162b1bc-c6af-41c6-b010-0d01388812be tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.737249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4162b1bc-c6af-41c6-b010-0d01388812be tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:13.766799 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4162b1bc-c6af-41c6-b010-0d01388812be tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.667394 Dec 16 14:42:13.774471 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 247/511] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:13 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:14.158701 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-a42286d0-af1e-4bba-96c3-90f893b9afce req-f5e3ef80-703b-4d9b-bf81-6ecea1ac93d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6e43c8-eea5-48d0-b7bf-ff18381a0f20", "tag": "a1de2547-6459-4d87-9d1f-a9adfc216809"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:14.187195 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:14.187195 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:42:14.203587 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:14.211316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-a42286d0-af1e-4bba-96c3-90f893b9afce req-f5e3ef80-703b-4d9b-bf81-6ecea1ac93d9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.211955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-a42286d0-af1e-4bba-96c3-90f893b9afce req-f5e3ef80-703b-4d9b-bf81-6ecea1ac93d9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.258335 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:14.275542 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:14.278988 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-48fa6a87-fa04-40b8-bc59-716ba3eb0689 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 1.415747 Dec 16 14:42:14.294345 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 265/512] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:12 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:14.297417 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-a42286d0-af1e-4bba-96c3-90f893b9afce req-f5e3ef80-703b-4d9b-bf81-6ecea1ac93d9 service nova] Creating event network-changed:a1de2547-6459-4d87-9d1f-a9adfc216809 for instance fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 on hv-cinder-82189 Dec 16 14:42:14.306762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-a42286d0-af1e-4bba-96c3-90f893b9afce req-f5e3ef80-703b-4d9b-bf81-6ecea1ac93d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183504 Dec 16 14:42:14.308549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 248/513] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:14.813538 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0ed71c1c-da14-4c8b-9d65-6140a1b02e11 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:14.827532 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0ed71c1c-da14-4c8b-9d65-6140a1b02e11 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:14.852537 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ed71c1c-da14-4c8b-9d65-6140a1b02e11 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.854589 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ed71c1c-da14-4c8b-9d65-6140a1b02e11 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.865743 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ed71c1c-da14-4c8b-9d65-6140a1b02e11 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.867067 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ed71c1c-da14-4c8b-9d65-6140a1b02e11 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.336525 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:15.339860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:15.376150 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.377431 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.380706 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.381731 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.762349 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0ed71c1c-da14-4c8b-9d65-6140a1b02e11 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:15.780245 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0ed71c1c-da14-4c8b-9d65-6140a1b02e11 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.995131 Dec 16 14:42:15.782699 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 266/514] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:14 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:15.900955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:15.926763 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:15.937083 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:15.939207 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6396b7fd-9268-4fc5-866a-c5e031fccf09 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.626375 Dec 16 14:42:15.940217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 249/515] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:15 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:16.832135 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-86222158-31ff-42e6-8958-c7596e8de031 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:16.839925 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-86222158-31ff-42e6-8958-c7596e8de031 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:16.864678 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86222158-31ff-42e6-8958-c7596e8de031 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:16.865944 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86222158-31ff-42e6-8958-c7596e8de031 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:16.867736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86222158-31ff-42e6-8958-c7596e8de031 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:16.868715 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86222158-31ff-42e6-8958-c7596e8de031 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:16.980441 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:16.982799 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:16.998094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.003121 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.017492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.019952 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.835988 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:17.876697 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:17.885080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:17.905151 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7c4aa626-5772-4a4f-aec1-561076db3d2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.947491 Dec 16 14:42:17.907131 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 250/516] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:16 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:17.968638 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-86222158-31ff-42e6-8958-c7596e8de031 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:17.985277 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-86222158-31ff-42e6-8958-c7596e8de031 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 1.180783 Dec 16 14:42:17.987229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 267/517] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:16 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:18.944557 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:18.945506 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:18.956469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.957210 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.962238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.962238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.028310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6c9fe283-edd9-4d8b-8db9-919553497bc4 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:19.029437 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6c9fe283-edd9-4d8b-8db9-919553497bc4 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:19.045203 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6c9fe283-edd9-4d8b-8db9-919553497bc4 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.046164 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6c9fe283-edd9-4d8b-8db9-919553497bc4 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.047850 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6c9fe283-edd9-4d8b-8db9-919553497bc4 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.048629 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6c9fe283-edd9-4d8b-8db9-919553497bc4 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.376378 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:19.398894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:19.413814 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6c9fe283-edd9-4d8b-8db9-919553497bc4 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:19.416324 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:19.418238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b6ec5d51-2aed-4116-9140-01a1c7c6d90b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.489882 Dec 16 14:42:19.419264 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 251/518] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:18 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:19.433834 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6c9fe283-edd9-4d8b-8db9-919553497bc4 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.427474 Dec 16 14:42:19.435468 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 268/519] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:19 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:20.456236 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:20.458582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:20.480127 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.481116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.483848 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.483848 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.505275 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2a846b31-618e-4586-a408-1bf5398004d0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:20.520892 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2a846b31-618e-4586-a408-1bf5398004d0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:20.546212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2a846b31-618e-4586-a408-1bf5398004d0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.547335 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2a846b31-618e-4586-a408-1bf5398004d0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.549549 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2a846b31-618e-4586-a408-1bf5398004d0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.552045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2a846b31-618e-4586-a408-1bf5398004d0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.097564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:21.132818 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:21.144234 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:21.146015 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c7d617c7-d9e2-4f9b-aabf-4600e60110e4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.710800 Dec 16 14:42:21.160657 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 252/520] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:20 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:21.286861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2a846b31-618e-4586-a408-1bf5398004d0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:21.317813 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2a846b31-618e-4586-a408-1bf5398004d0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.867414 Dec 16 14:42:21.324247 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 269/521] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:20 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:22.187708 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:22.191305 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:22.248394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.252446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.254201 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.254888 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.373007 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ffb3bc3b-13b7-4da2-b458-1ac197431550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:22.374893 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ffb3bc3b-13b7-4da2-b458-1ac197431550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:22.409909 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ffb3bc3b-13b7-4da2-b458-1ac197431550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.411444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ffb3bc3b-13b7-4da2-b458-1ac197431550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.425170 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ffb3bc3b-13b7-4da2-b458-1ac197431550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.431497 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ffb3bc3b-13b7-4da2-b458-1ac197431550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:23.352084 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:23.392403 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:23.416199 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:23.419378 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-918dc7e2-1c8d-4121-85ed-4e0cef3b610c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 1.252066 Dec 16 14:42:23.420981 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 253/522] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:22 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:23.662384 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ffb3bc3b-13b7-4da2-b458-1ac197431550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:23.692172 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ffb3bc3b-13b7-4da2-b458-1ac197431550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 1.354083 Dec 16 14:42:23.692885 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 270/523] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:22 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:24.473790 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:24.490813 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:24.530865 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.532079 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.533863 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.534970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.727328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5f58c3fc-8ce5-4ba2-be07-16baa1059fee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:24.730266 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5f58c3fc-8ce5-4ba2-be07-16baa1059fee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:24.751698 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f58c3fc-8ce5-4ba2-be07-16baa1059fee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.752561 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f58c3fc-8ce5-4ba2-be07-16baa1059fee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.771463 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f58c3fc-8ce5-4ba2-be07-16baa1059fee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.775940 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f58c3fc-8ce5-4ba2-be07-16baa1059fee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.260832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:25.379156 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:25.408333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:25.410961 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-af1b97d3-0b37-44d1-a866-91d82eb3f792 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.970338 Dec 16 14:42:25.412703 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 254/524] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:24 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:26.091633 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5f58c3fc-8ce5-4ba2-be07-16baa1059fee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:26.122744 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5f58c3fc-8ce5-4ba2-be07-16baa1059fee tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 1.411738 Dec 16 14:42:26.125924 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 271/525] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:24 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:26.471960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:26.482640 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:26.525694 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:26.531139 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:26.534497 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:26.538837 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.200368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-46e585e7-b12e-4679-8176-615bfd4ea9cf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:27.212176 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-46e585e7-b12e-4679-8176-615bfd4ea9cf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:27.268356 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-46e585e7-b12e-4679-8176-615bfd4ea9cf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:27.280144 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-46e585e7-b12e-4679-8176-615bfd4ea9cf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.282912 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-46e585e7-b12e-4679-8176-615bfd4ea9cf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:27.284089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-46e585e7-b12e-4679-8176-615bfd4ea9cf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.304010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:27.331300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:27.344167 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:27.346262 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-66bfde81-b885-4894-a06d-4ea147708d9b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.912890 Dec 16 14:42:27.361630 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 255/526] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:26 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:28.430539 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:28.431791 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:28.478130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.479025 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.480472 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.481276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.642384 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-46e585e7-b12e-4679-8176-615bfd4ea9cf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:28.675813 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-46e585e7-b12e-4679-8176-615bfd4ea9cf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 1.530466 Dec 16 14:42:28.679277 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 272/527] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:27 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:29.715366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cc0f02d6-10cf-4990-88c1-679e7c162315 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:29.725548 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cc0f02d6-10cf-4990-88c1-679e7c162315 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:29.746414 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc0f02d6-10cf-4990-88c1-679e7c162315 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:29.748802 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc0f02d6-10cf-4990-88c1-679e7c162315 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.751694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc0f02d6-10cf-4990-88c1-679e7c162315 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:29.756276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc0f02d6-10cf-4990-88c1-679e7c162315 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.765395 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:29.858991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:29.897153 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:29.900058 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0882eb56-a219-4f15-ad04-7ecafb7f9da9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 1.535267 Dec 16 14:42:29.908306 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 256/528] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:28 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:30.869592 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cc0f02d6-10cf-4990-88c1-679e7c162315 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:30.935792 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cc0f02d6-10cf-4990-88c1-679e7c162315 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 1.232292 Dec 16 14:42:30.950725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 273/529] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:29 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:30.981889 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:30.988460 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:31.006780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:31.008194 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:31.011171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:31.012925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:31.832296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:31.919662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:31.988757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:31.991039 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-10298b97-7290-4746-bc19-29c6146a3aa2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 1.060380 Dec 16 14:42:31.991960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 257/530] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:30 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:32.005063 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d1ca9e17-06b1-4f77-9a78-82e7160ccc3e tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:32.019493 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d1ca9e17-06b1-4f77-9a78-82e7160ccc3e tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:32.044232 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e17-06b1-4f77-9a78-82e7160ccc3e tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:32.045012 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e17-06b1-4f77-9a78-82e7160ccc3e tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:32.046716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e17-06b1-4f77-9a78-82e7160ccc3e tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:32.047683 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1ca9e17-06b1-4f77-9a78-82e7160ccc3e tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:32.749389 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d1ca9e17-06b1-4f77-9a78-82e7160ccc3e tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:32.767327 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d1ca9e17-06b1-4f77-9a78-82e7160ccc3e tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.801901 Dec 16 14:42:32.770509 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 274/531] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:31 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:33.029681 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:33.031264 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:33.046824 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.048099 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.050270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.051711 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.549925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:33.568645 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:33.576794 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:33.578192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2f1253d1-7fc6-4786-93fb-e422bd20545a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.569598 Dec 16 14:42:33.593847 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 258/532] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:33 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:33.796739 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2be7900d-dd6a-44d0-9bcb-c05a1f549503 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:33.798977 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2be7900d-dd6a-44d0-9bcb-c05a1f549503 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:33.817506 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2be7900d-dd6a-44d0-9bcb-c05a1f549503 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.818461 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2be7900d-dd6a-44d0-9bcb-c05a1f549503 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.823094 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2be7900d-dd6a-44d0-9bcb-c05a1f549503 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.824216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2be7900d-dd6a-44d0-9bcb-c05a1f549503 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:34.259204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2be7900d-dd6a-44d0-9bcb-c05a1f549503 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:34.278397 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2be7900d-dd6a-44d0-9bcb-c05a1f549503 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.496894 Dec 16 14:42:34.287703 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 275/533] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:33 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:34.564860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1569077814", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "networks": [{"uuid": "44ed6d9d-119a-453b-8449-3d06aaf1b554"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:34.627861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:34.629009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:34.642934 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:34.643679 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:34.645054 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:34.645717 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:34.721360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] validate_networks() for [('44ed6d9d-119a-453b-8449-3d06aaf1b554', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:42:35.129205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:35.176452 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:35.191010 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:35.193909 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e1dbf247-71c5-4a73-a166-0935bbcc15c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.586847 Dec 16 14:42:35.210273 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 276/534] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:34 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:35.262527 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ddd483d3-8007-46bd-9b54-5b6765d2d455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:35.263819 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ddd483d3-8007-46bd-9b54-5b6765d2d455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:35.273798 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ddd483d3-8007-46bd-9b54-5b6765d2d455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.274358 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ddd483d3-8007-46bd-9b54-5b6765d2d455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:35.275246 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ddd483d3-8007-46bd-9b54-5b6765d2d455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.275683 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ddd483d3-8007-46bd-9b54-5b6765d2d455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:35.359700 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-ddd483d3-8007-46bd-9b54-5b6765d2d455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lazy-loading 'flavor' on Instance uuid 618e7310-603e-4003-b2d6-b05eb18cd558 {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:42:35.846195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ddd483d3-8007-46bd-9b54-5b6765d2d455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/action" status: 200 len: 32 microversion: 2.1 time: 0.595097 Dec 16 14:42:35.847584 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 277/535] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:42:35 2021] POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/action => generated 32 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:42:35.868263 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d1731062-a505-4024-ad49-7fb327249055 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:35.868855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d1731062-a505-4024-ad49-7fb327249055 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:35.884864 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1731062-a505-4024-ad49-7fb327249055 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.885636 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1731062-a505-4024-ad49-7fb327249055 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:35.888765 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1731062-a505-4024-ad49-7fb327249055 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.889766 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1731062-a505-4024-ad49-7fb327249055 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:35.953962 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:42:35.955714 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:42:35.956893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:42:35.957526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:42:35.958537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:42:35.976004 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.977315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:35.979382 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.981649 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:36.030674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Getting quotas for project 841e959321694bbe969318fafd7f676b. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:42:36.040372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Getting quotas for user 62521c33250d4e528a7c1edd5c0dda0b and project 841e959321694bbe969318fafd7f676b. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:42:36.064540 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:42:36.069791 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:42:36.170552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fcfb33c5-b1e9-43ad-bbbf-ce79dd7712c1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.643965 Dec 16 14:42:36.177417 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 259/536] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:42:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:42:36.210513 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b49600a2-909e-4f66-8c09-065fe2340e54 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:36.211952 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b49600a2-909e-4f66-8c09-065fe2340e54 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:36.226607 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b49600a2-909e-4f66-8c09-065fe2340e54 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:36.227785 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b49600a2-909e-4f66-8c09-065fe2340e54 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:36.230352 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b49600a2-909e-4f66-8c09-065fe2340e54 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:36.231727 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b49600a2-909e-4f66-8c09-065fe2340e54 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:36.600041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d1731062-a505-4024-ad49-7fb327249055 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:36.625525 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d1731062-a505-4024-ad49-7fb327249055 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.776402 Dec 16 14:42:36.626869 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 278/537] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:35 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:36.649747 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f1789692-3ea8-49ef-9cbf-18dfdb04013c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:36.652767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f1789692-3ea8-49ef-9cbf-18dfdb04013c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:36.805494 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b49600a2-909e-4f66-8c09-065fe2340e54 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:36.808192 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f1789692-3ea8-49ef-9cbf-18dfdb04013c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:36.823102 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b49600a2-909e-4f66-8c09-065fe2340e54 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.643272 Dec 16 14:42:36.829277 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f1789692-3ea8-49ef-9cbf-18dfdb04013c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1219 microversion: 2.1 time: 0.200751 Dec 16 14:42:36.838700 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 260/538] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:36 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:36.840118 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 279/539] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:36 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:36.861383 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:36.863152 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:36.880277 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:36.881500 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:36.883355 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:36.884526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.324543 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:37.355059 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:37.363887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:37.365323 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b0e9a1ed-b86f-4f8c-8b4a-18c41198a376 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.524766 Dec 16 14:42:37.366243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 261/540] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:36 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:37.662182 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-03c12bc6-1c3d-4c1c-92d3-943e99614550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:37.664451 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-03c12bc6-1c3d-4c1c-92d3-943e99614550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:37.676877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-03c12bc6-1c3d-4c1c-92d3-943e99614550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.677661 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-03c12bc6-1c3d-4c1c-92d3-943e99614550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.678757 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-03c12bc6-1c3d-4c1c-92d3-943e99614550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.679356 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-03c12bc6-1c3d-4c1c-92d3-943e99614550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.879889 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-32c07f8f-03d4-4fe3-8e21-1d6e6f2b6e3e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:37.880404 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-32c07f8f-03d4-4fe3-8e21-1d6e6f2b6e3e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:37.904070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-32c07f8f-03d4-4fe3-8e21-1d6e6f2b6e3e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.905018 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-32c07f8f-03d4-4fe3-8e21-1d6e6f2b6e3e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.905879 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-32c07f8f-03d4-4fe3-8e21-1d6e6f2b6e3e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.906342 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-32c07f8f-03d4-4fe3-8e21-1d6e6f2b6e3e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.082344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-03c12bc6-1c3d-4c1c-92d3-943e99614550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:38.092962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-03c12bc6-1c3d-4c1c-92d3-943e99614550 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.443290 Dec 16 14:42:38.093776 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 280/541] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:37 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:38.105217 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b12b0b19-c5e7-44d0-82be-235ef7f30f65 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:38.106343 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b12b0b19-c5e7-44d0-82be-235ef7f30f65 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:38.118523 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b12b0b19-c5e7-44d0-82be-235ef7f30f65 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.119360 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b12b0b19-c5e7-44d0-82be-235ef7f30f65 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.120488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b12b0b19-c5e7-44d0-82be-235ef7f30f65 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.121336 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b12b0b19-c5e7-44d0-82be-235ef7f30f65 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.310638 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b12b0b19-c5e7-44d0-82be-235ef7f30f65 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:38.320055 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b12b0b19-c5e7-44d0-82be-235ef7f30f65 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1271 microversion: 2.1 time: 0.224800 Dec 16 14:42:38.329911 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 281/542] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:38 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:38.404055 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:38.405392 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:38.420971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-32c07f8f-03d4-4fe3-8e21-1d6e6f2b6e3e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:38.424522 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.425503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.427170 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.428087 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.438838 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-32c07f8f-03d4-4fe3-8e21-1d6e6f2b6e3e tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.590793 Dec 16 14:42:38.440221 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 262/543] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:37 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:38.993507 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:39.045455 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:39.064885 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:39.067986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7610ff0f-e175-43d3-95ba-8678328409a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.684916 Dec 16 14:42:39.069326 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 282/544] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:38 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:39.138949 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4cf2b5ce-bbb7-4529-832e-94f4c8489cc7 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:39.143566 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4cf2b5ce-bbb7-4529-832e-94f4c8489cc7 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:39.173676 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4cf2b5ce-bbb7-4529-832e-94f4c8489cc7 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.177683 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4cf2b5ce-bbb7-4529-832e-94f4c8489cc7 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.182275 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4cf2b5ce-bbb7-4529-832e-94f4c8489cc7 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.190715 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4cf2b5ce-bbb7-4529-832e-94f4c8489cc7 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.372338 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c6eb5463-e5b5-44dc-b649-72b3b74ab9a6 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:39.380789 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c6eb5463-e5b5-44dc-b649-72b3b74ab9a6 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:39.413607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6eb5463-e5b5-44dc-b649-72b3b74ab9a6 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.414939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6eb5463-e5b5-44dc-b649-72b3b74ab9a6 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.416198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6eb5463-e5b5-44dc-b649-72b3b74ab9a6 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.416654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6eb5463-e5b5-44dc-b649-72b3b74ab9a6 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.672703 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c6eb5463-e5b5-44dc-b649-72b3b74ab9a6 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:39.686596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c6eb5463-e5b5-44dc-b649-72b3b74ab9a6 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1277 microversion: 2.1 time: 0.352475 Dec 16 14:42:39.700162 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 283/545] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:39 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1277 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:39.721879 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cc748520-416b-4f59-86fa-a7b1c3a23106 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:39.722547 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cc748520-416b-4f59-86fa-a7b1c3a23106 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:39.744193 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc748520-416b-4f59-86fa-a7b1c3a23106 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.744699 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc748520-416b-4f59-86fa-a7b1c3a23106 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.745425 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc748520-416b-4f59-86fa-a7b1c3a23106 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.746177 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cc748520-416b-4f59-86fa-a7b1c3a23106 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:40.306020 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4cf2b5ce-bbb7-4529-832e-94f4c8489cc7 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:40.332266 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4cf2b5ce-bbb7-4529-832e-94f4c8489cc7 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 1.224453 Dec 16 14:42:40.333536 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 263/546] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:39 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:40.356709 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:40.357747 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:40.367200 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:40.368042 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:40.369095 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:40.369735 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:40.498083 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cc748520-416b-4f59-86fa-a7b1c3a23106 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:40.509668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cc748520-416b-4f59-86fa-a7b1c3a23106 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.807950 Dec 16 14:42:40.521200 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 284/547] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:39 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:40.712521 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-723a5f57-8171-4827-ac04-b1da961d735f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:40.713635 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-723a5f57-8171-4827-ac04-b1da961d735f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:40.743000 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-723a5f57-8171-4827-ac04-b1da961d735f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:40.743770 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-723a5f57-8171-4827-ac04-b1da961d735f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:40.745034 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-723a5f57-8171-4827-ac04-b1da961d735f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:40.745869 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-723a5f57-8171-4827-ac04-b1da961d735f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.135158 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:41.165975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:41.190915 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:41.202315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ea194445-d26d-42ca-a0c1-d50e2edbffb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.863756 Dec 16 14:42:41.203548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 264/548] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:40 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:41.368582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-87b3bcd6-d9f8-4c1f-abee-cac95457585c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:41.370497 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-87b3bcd6-d9f8-4c1f-abee-cac95457585c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:41.381832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-87b3bcd6-d9f8-4c1f-abee-cac95457585c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.382623 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-87b3bcd6-d9f8-4c1f-abee-cac95457585c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.383556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-87b3bcd6-d9f8-4c1f-abee-cac95457585c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.384059 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-87b3bcd6-d9f8-4c1f-abee-cac95457585c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.477194 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-723a5f57-8171-4827-ac04-b1da961d735f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:41.488810 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-723a5f57-8171-4827-ac04-b1da961d735f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 0.788500 Dec 16 14:42:41.500512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 285/549] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:40 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:41.535193 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0059b50b-cf89-4bd5-905f-e4c330fb38b2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:41.535988 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0059b50b-cf89-4bd5-905f-e4c330fb38b2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:41.546138 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0059b50b-cf89-4bd5-905f-e4c330fb38b2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.546943 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0059b50b-cf89-4bd5-905f-e4c330fb38b2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.547937 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0059b50b-cf89-4bd5-905f-e4c330fb38b2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.548394 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0059b50b-cf89-4bd5-905f-e4c330fb38b2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.866531 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-87b3bcd6-d9f8-4c1f-abee-cac95457585c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:41.900381 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-87b3bcd6-d9f8-4c1f-abee-cac95457585c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.545889 Dec 16 14:42:41.901763 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 265/550] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:41 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:42.170133 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0059b50b-cf89-4bd5-905f-e4c330fb38b2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:42.181435 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0059b50b-cf89-4bd5-905f-e4c330fb38b2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.657179 Dec 16 14:42:42.182284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 286/551] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:41 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:42.257163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:42.259298 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:42.275328 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:42.276379 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:42.279066 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:42.280804 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:42.513284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-75655a45-5184-435c-b926-4f7376ee6584 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:42.515504 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-75655a45-5184-435c-b926-4f7376ee6584 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:42.525154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75655a45-5184-435c-b926-4f7376ee6584 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:42.525977 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75655a45-5184-435c-b926-4f7376ee6584 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:42.527137 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75655a45-5184-435c-b926-4f7376ee6584 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:42.528030 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-75655a45-5184-435c-b926-4f7376ee6584 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.291394 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-75655a45-5184-435c-b926-4f7376ee6584 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:43.331674 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-75655a45-5184-435c-b926-4f7376ee6584 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 0.828368 Dec 16 14:42:43.337186 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 287/552] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:42 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:43.371462 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:43.372718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-44def8f5-5b7b-4b46-b988-f14e15205cb3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:43.374328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-44def8f5-5b7b-4b46-b988-f14e15205cb3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:43.388200 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44def8f5-5b7b-4b46-b988-f14e15205cb3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.389318 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44def8f5-5b7b-4b46-b988-f14e15205cb3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.391035 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44def8f5-5b7b-4b46-b988-f14e15205cb3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.392016 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44def8f5-5b7b-4b46-b988-f14e15205cb3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.423238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:43.437010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:43.440748 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-151a9f71-8587-4b02-b438-2b31bea50b8f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 1.208978 Dec 16 14:42:43.441894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 266/553] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:42 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:43.466305 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7af2461a-62a3-410c-a838-b961b875e990 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:43.467572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7af2461a-62a3-410c-a838-b961b875e990 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:43.476264 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7af2461a-62a3-410c-a838-b961b875e990 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.477132 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7af2461a-62a3-410c-a838-b961b875e990 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.478424 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7af2461a-62a3-410c-a838-b961b875e990 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.479431 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7af2461a-62a3-410c-a838-b961b875e990 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.862012 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7af2461a-62a3-410c-a838-b961b875e990 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:43.873764 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7af2461a-62a3-410c-a838-b961b875e990 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.429184 Dec 16 14:42:43.886202 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 267/554] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:43 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:43.899525 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-52aa7f7f-d781-4954-af42-e97b99d32271 req-6d0feff8-e7f1-46b5-8460-7188fe4aec74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8", "tag": "e2d3277a-945e-4ae4-95c3-d817894dc3e0"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:43.906853 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:43.906853 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:42:43.918658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-52aa7f7f-d781-4954-af42-e97b99d32271 req-6d0feff8-e7f1-46b5-8460-7188fe4aec74 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.919484 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-52aa7f7f-d781-4954-af42-e97b99d32271 req-6d0feff8-e7f1-46b5-8460-7188fe4aec74 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.956196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-52aa7f7f-d781-4954-af42-e97b99d32271 req-6d0feff8-e7f1-46b5-8460-7188fe4aec74 service nova] Creating event network-changed:e2d3277a-945e-4ae4-95c3-d817894dc3e0 for instance f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 on hv-cinder-82189 Dec 16 14:42:43.966251 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-52aa7f7f-d781-4954-af42-e97b99d32271 req-6d0feff8-e7f1-46b5-8460-7188fe4aec74 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077996 Dec 16 14:42:43.967803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 268/555] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:44.240022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-44def8f5-5b7b-4b46-b988-f14e15205cb3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:44.252048 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-44def8f5-5b7b-4b46-b988-f14e15205cb3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.907568 Dec 16 14:42:44.253054 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 288/556] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:43 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:44.366711 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-195ed45f-23a8-4af5-a351-05cfdcda9e04 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:44.368633 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-195ed45f-23a8-4af5-a351-05cfdcda9e04 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:44.383308 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-195ed45f-23a8-4af5-a351-05cfdcda9e04 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.384548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-195ed45f-23a8-4af5-a351-05cfdcda9e04 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.385516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-195ed45f-23a8-4af5-a351-05cfdcda9e04 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.386987 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-195ed45f-23a8-4af5-a351-05cfdcda9e04 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.506147 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:44.507880 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:44.523447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.524915 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.526896 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.528434 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.734721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-195ed45f-23a8-4af5-a351-05cfdcda9e04 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:44.745412 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-195ed45f-23a8-4af5-a351-05cfdcda9e04 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 0.393278 Dec 16 14:42:44.750036 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 269/557] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:44 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:44.906972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e786542c-dc32-4662-9e0b-9e928ae42d92 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:44.913031 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e786542c-dc32-4662-9e0b-9e928ae42d92 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:44.930601 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e786542c-dc32-4662-9e0b-9e928ae42d92 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.932616 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e786542c-dc32-4662-9e0b-9e928ae42d92 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.934518 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e786542c-dc32-4662-9e0b-9e928ae42d92 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.935464 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e786542c-dc32-4662-9e0b-9e928ae42d92 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:45.288003 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e786542c-dc32-4662-9e0b-9e928ae42d92 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:45.331284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e786542c-dc32-4662-9e0b-9e928ae42d92 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.441559 Dec 16 14:42:45.340862 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:45.346209 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 270/558] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:44 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:45.396684 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e94f7f02-6542-4743-97b0-d4e4329a31fa tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:45.401039 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e94f7f02-6542-4743-97b0-d4e4329a31fa tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:45.408478 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:45.436516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e94f7f02-6542-4743-97b0-d4e4329a31fa tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:45.441801 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e94f7f02-6542-4743-97b0-d4e4329a31fa tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:45.444192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e94f7f02-6542-4743-97b0-d4e4329a31fa tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:45.445882 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:45.447023 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e94f7f02-6542-4743-97b0-d4e4329a31fa tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:45.449144 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-636c8b28-5817-49ce-bced-e0b302283975 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.978855 Dec 16 14:42:45.451494 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 289/559] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:44 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:45.816944 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e94f7f02-6542-4743-97b0-d4e4329a31fa tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:45.818709 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7d483b96-b139-423d-9e1f-db5a178a2a09 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:45.819758 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7d483b96-b139-423d-9e1f-db5a178a2a09 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:45.831525 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e94f7f02-6542-4743-97b0-d4e4329a31fa tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.482985 Dec 16 14:42:45.832008 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 271/560] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:45 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:45.835734 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7d483b96-b139-423d-9e1f-db5a178a2a09 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:45.836481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7d483b96-b139-423d-9e1f-db5a178a2a09 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:45.838998 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7d483b96-b139-423d-9e1f-db5a178a2a09 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:45.839759 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7d483b96-b139-423d-9e1f-db5a178a2a09 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.371260 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4b3bd98d-d04c-4163-86bd-fb8d7ca1cb86 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:46.373926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4b3bd98d-d04c-4163-86bd-fb8d7ca1cb86 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:46.387701 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4b3bd98d-d04c-4163-86bd-fb8d7ca1cb86 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.389120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4b3bd98d-d04c-4163-86bd-fb8d7ca1cb86 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.393530 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4b3bd98d-d04c-4163-86bd-fb8d7ca1cb86 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.394259 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4b3bd98d-d04c-4163-86bd-fb8d7ca1cb86 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.404310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7d483b96-b139-423d-9e1f-db5a178a2a09 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:46.424393 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7d483b96-b139-423d-9e1f-db5a178a2a09 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 0.651823 Dec 16 14:42:46.425553 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 290/561] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:45 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:46.508452 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:46.510151 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:46.527772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.528726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.530287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.531319 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.826587 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4b3bd98d-d04c-4163-86bd-fb8d7ca1cb86 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:46.846887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4b3bd98d-d04c-4163-86bd-fb8d7ca1cb86 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.496265 Dec 16 14:42:46.860785 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:46.862530 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 272/562] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:46 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:46.899597 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:46.908237 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9b8a7331-75dc-4d30-adce-fbf02dec6b2b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:46.909425 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9b8a7331-75dc-4d30-adce-fbf02dec6b2b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:46.925284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:46.926671 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9b8a7331-75dc-4d30-adce-fbf02dec6b2b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.927170 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8b9f7840-2393-458c-b2d8-01002cacb9c8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.445889 Dec 16 14:42:46.927362 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9b8a7331-75dc-4d30-adce-fbf02dec6b2b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.928057 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 291/563] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:46 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:46.929004 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9b8a7331-75dc-4d30-adce-fbf02dec6b2b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.929737 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9b8a7331-75dc-4d30-adce-fbf02dec6b2b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.056300 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-e1ad8a2b-b410-4f59-8b4b-6a2d17e46726 req-46c70352-1d89-4757-a83e-1f10ad63a0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6e43c8-eea5-48d0-b7bf-ff18381a0f20", "name": "network-vif-plugged", "status": "completed", "tag": "a1de2547-6459-4d87-9d1f-a9adfc216809"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:47.103227 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:47.103227 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:42:47.125122 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-e1ad8a2b-b410-4f59-8b4b-6a2d17e46726 req-46c70352-1d89-4757-a83e-1f10ad63a0e4 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.128705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-e1ad8a2b-b410-4f59-8b4b-6a2d17e46726 req-46c70352-1d89-4757-a83e-1f10ad63a0e4 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.215879 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-e1ad8a2b-b410-4f59-8b4b-6a2d17e46726 req-46c70352-1d89-4757-a83e-1f10ad63a0e4 service nova] Creating event network-vif-plugged:a1de2547-6459-4d87-9d1f-a9adfc216809 for instance fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 on hv-cinder-82189 Dec 16 14:42:47.240635 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-e1ad8a2b-b410-4f59-8b4b-6a2d17e46726 req-46c70352-1d89-4757-a83e-1f10ad63a0e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225271 Dec 16 14:42:47.243574 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 292/564] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:47.464300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9b8a7331-75dc-4d30-adce-fbf02dec6b2b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:47.480662 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b2589840-52ed-4fdb-ad06-513df08d3640 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:47.481641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9b8a7331-75dc-4d30-adce-fbf02dec6b2b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.616816 Dec 16 14:42:47.483142 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 273/565] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:46 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:47.484497 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b2589840-52ed-4fdb-ad06-513df08d3640 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:47.508845 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b2589840-52ed-4fdb-ad06-513df08d3640 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.510089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b2589840-52ed-4fdb-ad06-513df08d3640 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.511826 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b2589840-52ed-4fdb-ad06-513df08d3640 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.512883 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b2589840-52ed-4fdb-ad06-513df08d3640 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.882518 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fa74e13b-e51f-4995-82b4-3db31524c763 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:47.884703 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fa74e13b-e51f-4995-82b4-3db31524c763 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:47.895220 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa74e13b-e51f-4995-82b4-3db31524c763 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.896271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa74e13b-e51f-4995-82b4-3db31524c763 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.897368 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa74e13b-e51f-4995-82b4-3db31524c763 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.897909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa74e13b-e51f-4995-82b4-3db31524c763 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:48.073958 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b2589840-52ed-4fdb-ad06-513df08d3640 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:48.090176 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b2589840-52ed-4fdb-ad06-513df08d3640 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 0.641445 Dec 16 14:42:48.092980 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 293/566] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:47 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:48.118094 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:48.119609 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:48.138277 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:48.139190 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:48.141119 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:48.142185 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:48.463105 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fa74e13b-e51f-4995-82b4-3db31524c763 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:48.482349 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fa74e13b-e51f-4995-82b4-3db31524c763 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.611329 Dec 16 14:42:48.484641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 274/567] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:47 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:48.519527 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:48.529792 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d775bc73-ee79-4361-a4cc-cae50dbb994c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:48.532239 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d775bc73-ee79-4361-a4cc-cae50dbb994c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:48.549255 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:48.551816 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d775bc73-ee79-4361-a4cc-cae50dbb994c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:48.554020 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d775bc73-ee79-4361-a4cc-cae50dbb994c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:48.557645 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d775bc73-ee79-4361-a4cc-cae50dbb994c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:48.561679 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d775bc73-ee79-4361-a4cc-cae50dbb994c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:48.564366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:48.566891 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ab3f3ab5-c4af-4b5f-8d7b-2bc068ee02bd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.471991 Dec 16 14:42:48.567692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 294/568] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:48 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:48.846907 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d775bc73-ee79-4361-a4cc-cae50dbb994c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:48.856470 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d775bc73-ee79-4361-a4cc-cae50dbb994c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.350734 Dec 16 14:42:48.866422 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 275/569] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:48 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:49.118130 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c1aaf59f-6d3a-4b9d-bd81-d481e07ce563 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:49.119185 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c1aaf59f-6d3a-4b9d-bd81-d481e07ce563 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:49.133749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c1aaf59f-6d3a-4b9d-bd81-d481e07ce563 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.134224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c1aaf59f-6d3a-4b9d-bd81-d481e07ce563 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.135037 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c1aaf59f-6d3a-4b9d-bd81-d481e07ce563 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.135460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c1aaf59f-6d3a-4b9d-bd81-d481e07ce563 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.267650 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-12de473b-f686-4085-8d3b-d49c31ce5957 req-d3a117ae-9ca5-440f-a02d-16d79a2c4e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b5c02-69ca-4290-bba0-54d6ed2eb215", "name": "network-vif-plugged", "status": "completed", "tag": "e59517d2-2291-4c73-889e-594d9cc076e2"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:49.274835 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:49.274835 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:42:49.284677 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-12de473b-f686-4085-8d3b-d49c31ce5957 req-d3a117ae-9ca5-440f-a02d-16d79a2c4e58 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.285366 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-12de473b-f686-4085-8d3b-d49c31ce5957 req-d3a117ae-9ca5-440f-a02d-16d79a2c4e58 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.306038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-12de473b-f686-4085-8d3b-d49c31ce5957 req-d3a117ae-9ca5-440f-a02d-16d79a2c4e58 service nova] Creating event network-vif-plugged:e59517d2-2291-4c73-889e-594d9cc076e2 for instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 on hv-cinder-82189 Dec 16 14:42:49.315170 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-12de473b-f686-4085-8d3b-d49c31ce5957 req-d3a117ae-9ca5-440f-a02d-16d79a2c4e58 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058556 Dec 16 14:42:49.316875 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 276/570] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:49.456065 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c1aaf59f-6d3a-4b9d-bd81-d481e07ce563 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:49.465866 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c1aaf59f-6d3a-4b9d-bd81-d481e07ce563 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 0.358995 Dec 16 14:42:49.466749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 295/571] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:49 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:49.516734 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cb0b722e-8a09-47a5-8437-ee0234745d50 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:49.517433 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cb0b722e-8a09-47a5-8437-ee0234745d50 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:49.526933 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cb0b722e-8a09-47a5-8437-ee0234745d50 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.527678 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cb0b722e-8a09-47a5-8437-ee0234745d50 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.529040 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cb0b722e-8a09-47a5-8437-ee0234745d50 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.529712 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cb0b722e-8a09-47a5-8437-ee0234745d50 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.611811 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:49.614960 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:49.630378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.631171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.632544 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.633533 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.854329 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cb0b722e-8a09-47a5-8437-ee0234745d50 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:49.868276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cb0b722e-8a09-47a5-8437-ee0234745d50 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.361735 Dec 16 14:42:49.869309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 277/572] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:49 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:49.881936 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2e880dc7-bd90-4bda-bfce-b4a44bf3ead2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:49.882759 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2e880dc7-bd90-4bda-bfce-b4a44bf3ead2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:49.894988 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2e880dc7-bd90-4bda-bfce-b4a44bf3ead2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.895621 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2e880dc7-bd90-4bda-bfce-b4a44bf3ead2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.896595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2e880dc7-bd90-4bda-bfce-b4a44bf3ead2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.898144 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2e880dc7-bd90-4bda-bfce-b4a44bf3ead2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:50.160107 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:50.221524 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:50.242924 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:50.245495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-00ef1b5b-2789-475e-953b-b90e8793cd64 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.652934 Dec 16 14:42:50.247084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 296/573] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:49 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:50.452091 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2e880dc7-bd90-4bda-bfce-b4a44bf3ead2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:50.467880 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2e880dc7-bd90-4bda-bfce-b4a44bf3ead2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1257 microversion: 2.1 time: 0.596576 Dec 16 14:42:50.468998 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 278/574] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:49 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1257 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:50.510280 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e0d316ba-0070-490f-b31d-1198780d6924 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:50.511749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e0d316ba-0070-490f-b31d-1198780d6924 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:50.526135 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e0d316ba-0070-490f-b31d-1198780d6924 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:50.526833 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e0d316ba-0070-490f-b31d-1198780d6924 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:50.530195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e0d316ba-0070-490f-b31d-1198780d6924 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:50.530939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e0d316ba-0070-490f-b31d-1198780d6924 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:50.865806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e0d316ba-0070-490f-b31d-1198780d6924 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:50.880085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e0d316ba-0070-490f-b31d-1198780d6924 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 0.390532 Dec 16 14:42:50.880654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 297/575] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:50 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:50.911262 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4042dc62-4d29-443a-9f3f-fe6bd2a4e19c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:50.912430 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4042dc62-4d29-443a-9f3f-fe6bd2a4e19c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:50.924499 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4042dc62-4d29-443a-9f3f-fe6bd2a4e19c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:50.925213 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4042dc62-4d29-443a-9f3f-fe6bd2a4e19c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:50.927051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4042dc62-4d29-443a-9f3f-fe6bd2a4e19c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:50.928119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4042dc62-4d29-443a-9f3f-fe6bd2a4e19c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:51.259562 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4042dc62-4d29-443a-9f3f-fe6bd2a4e19c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:51.269924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4042dc62-4d29-443a-9f3f-fe6bd2a4e19c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.376855 Dec 16 14:42:51.270814 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 279/576] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:50 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:51.285782 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:51.286438 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:51.295205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:51.295652 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:51.296463 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:51.296893 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:51.506245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1156dd34-c206-4f44-bba2-b1408d3606b3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:51.508007 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1156dd34-c206-4f44-bba2-b1408d3606b3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:51.518903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1156dd34-c206-4f44-bba2-b1408d3606b3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:51.519459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1156dd34-c206-4f44-bba2-b1408d3606b3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:51.520336 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1156dd34-c206-4f44-bba2-b1408d3606b3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:51.520905 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1156dd34-c206-4f44-bba2-b1408d3606b3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:51.676329 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:51.693199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:51.701904 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:51.703159 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-bce6dcf5-fa78-4a65-a704-f25e2c399fd1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.432145 Dec 16 14:42:51.704019 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 298/577] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:51 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:51.834564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1156dd34-c206-4f44-bba2-b1408d3606b3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:51.845761 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1156dd34-c206-4f44-bba2-b1408d3606b3 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1441 microversion: 2.1 time: 0.354328 Dec 16 14:42:51.846578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 280/578] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:51 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1441 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:51.889221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-efde7b74-f5e7-4687-b7e8-33b48ed52a56 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:51.890431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-efde7b74-f5e7-4687-b7e8-33b48ed52a56 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:51.905297 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-efde7b74-f5e7-4687-b7e8-33b48ed52a56 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:51.905825 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-efde7b74-f5e7-4687-b7e8-33b48ed52a56 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:51.907281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-efde7b74-f5e7-4687-b7e8-33b48ed52a56 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:51.908044 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-efde7b74-f5e7-4687-b7e8-33b48ed52a56 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:51.910532 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-280c2997-a286-4446-9510-71b594470673 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:51.911147 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-280c2997-a286-4446-9510-71b594470673 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:51.919958 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-280c2997-a286-4446-9510-71b594470673 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:51.920404 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-280c2997-a286-4446-9510-71b594470673 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:51.921232 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-280c2997-a286-4446-9510-71b594470673 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:51.921659 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-280c2997-a286-4446-9510-71b594470673 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:52.236957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-efde7b74-f5e7-4687-b7e8-33b48ed52a56 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:52.248233 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-efde7b74-f5e7-4687-b7e8-33b48ed52a56 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1441 microversion: 2.1 time: 0.377578 Dec 16 14:42:52.249948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 299/579] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:51 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1441 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:52.272657 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-280c2997-a286-4446-9510-71b594470673 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:52.296549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-280c2997-a286-4446-9510-71b594470673 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 0.396260 Dec 16 14:42:52.297577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 281/580] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:51 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:52.305291 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f8367050-f64d-49bd-bfef-7934cddb9496 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:52.306301 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f8367050-f64d-49bd-bfef-7934cddb9496 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:52.316653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f8367050-f64d-49bd-bfef-7934cddb9496 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:52.317226 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f8367050-f64d-49bd-bfef-7934cddb9496 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:52.318133 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f8367050-f64d-49bd-bfef-7934cddb9496 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:52.318627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f8367050-f64d-49bd-bfef-7934cddb9496 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:52.768883 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:52.773299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:52.803563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:52.804357 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:52.805675 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:52.806406 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:53.024723 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f8367050-f64d-49bd-bfef-7934cddb9496 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:53.053060 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f8367050-f64d-49bd-bfef-7934cddb9496 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1568 microversion: 2.1 time: 0.768647 Dec 16 14:42:53.064260 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 300/581] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:52 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1568 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:53.075663 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-5288f809-74ec-4dfe-ae6a-4f0b49d858b9 req-13ef0a98-98dd-40ba-91b1-26361085a139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8", "name": "network-vif-plugged", "status": "completed", "tag": "e2d3277a-945e-4ae4-95c3-d817894dc3e0"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:53.084538 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:53.084538 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:42:53.094548 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5288f809-74ec-4dfe-ae6a-4f0b49d858b9 req-13ef0a98-98dd-40ba-91b1-26361085a139 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:53.095313 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5288f809-74ec-4dfe-ae6a-4f0b49d858b9 req-13ef0a98-98dd-40ba-91b1-26361085a139 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:53.120404 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-5288f809-74ec-4dfe-ae6a-4f0b49d858b9 req-13ef0a98-98dd-40ba-91b1-26361085a139 service nova] Creating event network-vif-plugged:e2d3277a-945e-4ae4-95c3-d817894dc3e0 for instance f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 on hv-cinder-82189 Dec 16 14:42:53.126954 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-5288f809-74ec-4dfe-ae6a-4f0b49d858b9 req-13ef0a98-98dd-40ba-91b1-26361085a139 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060839 Dec 16 14:42:53.127725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 301/582] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:53.351344 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:53.370298 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ec36aa90-2ee2-484f-a70b-cc56afcb816c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:53.371509 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ec36aa90-2ee2-484f-a70b-cc56afcb816c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:53.393372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:53.414560 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:53.417372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d158df93-13e7-472c-a2fd-7ea1d2684cbd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1808 microversion: 2.20 time: 0.693772 Dec 16 14:42:53.437749 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 282/583] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:52 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1808 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:53.438855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ec36aa90-2ee2-484f-a70b-cc56afcb816c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:53.441016 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ec36aa90-2ee2-484f-a70b-cc56afcb816c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:53.446052 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ec36aa90-2ee2-484f-a70b-cc56afcb816c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:53.447254 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ec36aa90-2ee2-484f-a70b-cc56afcb816c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.089739 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8d5b7bb4-dde9-43b8-912f-411d4c6f4499 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:54.090943 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8d5b7bb4-dde9-43b8-912f-411d4c6f4499 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:54.105632 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb4-dde9-43b8-912f-411d4c6f4499 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.106371 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb4-dde9-43b8-912f-411d4c6f4499 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.108072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb4-dde9-43b8-912f-411d4c6f4499 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.109104 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb4-dde9-43b8-912f-411d4c6f4499 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.464820 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8d5b7bb4-dde9-43b8-912f-411d4c6f4499 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:54.475168 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8d5b7bb4-dde9-43b8-912f-411d4c6f4499 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1548 microversion: 2.1 time: 0.406724 Dec 16 14:42:54.475628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 283/584] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:54 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1548 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:54.574951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ec36aa90-2ee2-484f-a70b-cc56afcb816c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:54.585406 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ec36aa90-2ee2-484f-a70b-cc56afcb816c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 1.264779 Dec 16 14:42:54.586914 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 302/585] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:53 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:54.605930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d17ee693-94c5-418f-828c-bd6363f332bb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:54.607766 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d17ee693-94c5-418f-828c-bd6363f332bb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:54.621826 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d17ee693-94c5-418f-828c-bd6363f332bb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.623291 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d17ee693-94c5-418f-828c-bd6363f332bb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.624985 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d17ee693-94c5-418f-828c-bd6363f332bb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.626075 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d17ee693-94c5-418f-828c-bd6363f332bb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.770836 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:54.772275 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:54.799415 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.800377 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.802734 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.803830 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.900046 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-d17ee693-94c5-418f-828c-bd6363f332bb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] HTTP exception thrown: Cannot 'detach_volume' instance 618e7310-603e-4003-b2d6-b05eb18cd558 while it is in vm_state rescued Dec 16 14:42:54.901510 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d17ee693-94c5-418f-828c-bd6363f332bb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Returning 409 to user: Cannot 'detach_volume' instance 618e7310-603e-4003-b2d6-b05eb18cd558 while it is in vm_state rescued {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:42:54.903060 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d17ee693-94c5-418f-828c-bd6363f332bb tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "DELETE /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments/7656ae02-9c74-4768-be6f-b3637280a988" status: 409 len: 152 microversion: 2.1 time: 0.314342 Dec 16 14:42:54.909108 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 303/586] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:42:54 2021] DELETE /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments/7656ae02-9c74-4768-be6f-b3637280a988 => generated 152 bytes in 321 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 14:42:54.931890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8acee65e-380b-4c9e-b5b7-6488a566977a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:54.932824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8acee65e-380b-4c9e-b5b7-6488a566977a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:54.951421 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8acee65e-380b-4c9e-b5b7-6488a566977a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.951771 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8acee65e-380b-4c9e-b5b7-6488a566977a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.952446 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8acee65e-380b-4c9e-b5b7-6488a566977a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.952884 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8acee65e-380b-4c9e-b5b7-6488a566977a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:55.257113 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8acee65e-380b-4c9e-b5b7-6488a566977a tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/action" status: 202 len: 0 microversion: 2.1 time: 0.345646 Dec 16 14:42:55.258307 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 304/587] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:42:54 2021] POST /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:42:55.283801 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4a507c1a-53fb-4a3f-bb6a-3513778810ec tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:55.285550 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4a507c1a-53fb-4a3f-bb6a-3513778810ec tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:55.295816 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4a507c1a-53fb-4a3f-bb6a-3513778810ec tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:55.296263 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4a507c1a-53fb-4a3f-bb6a-3513778810ec tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:55.298155 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4a507c1a-53fb-4a3f-bb6a-3513778810ec tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:55.298155 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4a507c1a-53fb-4a3f-bb6a-3513778810ec tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:55.372258 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:55.410961 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:55.419107 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:55.421284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7f6d80fe-8467-4cde-bf90-52e3b3a56ae0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1795 microversion: 2.20 time: 0.944486 Dec 16 14:42:55.422574 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 284/588] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:54 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1795 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:55.630402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b12a6cca-b2d1-49ba-b9da-019054713ff0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:55.631376 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b12a6cca-b2d1-49ba-b9da-019054713ff0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:55.641273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b12a6cca-b2d1-49ba-b9da-019054713ff0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:55.642131 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b12a6cca-b2d1-49ba-b9da-019054713ff0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:55.643143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b12a6cca-b2d1-49ba-b9da-019054713ff0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:55.643812 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b12a6cca-b2d1-49ba-b9da-019054713ff0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:56.112320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b12a6cca-b2d1-49ba-b9da-019054713ff0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:56.153532 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b12a6cca-b2d1-49ba-b9da-019054713ff0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1319 microversion: 2.1 time: 0.544979 Dec 16 14:42:56.166744 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4a507c1a-53fb-4a3f-bb6a-3513778810ec tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:56.167726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 285/589] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:55 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:56.196852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4a507c1a-53fb-4a3f-bb6a-3513778810ec tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1556 microversion: 2.1 time: 0.927270 Dec 16 14:42:56.207601 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 305/590] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:55 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1556 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:57.199768 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1d5f1bfc-3e3f-4f2c-9865-3352ced55e07 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:57.201142 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1d5f1bfc-3e3f-4f2c-9865-3352ced55e07 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:57.223903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1d5f1bfc-3e3f-4f2c-9865-3352ced55e07 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:57.224825 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1d5f1bfc-3e3f-4f2c-9865-3352ced55e07 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:57.226285 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1d5f1bfc-3e3f-4f2c-9865-3352ced55e07 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:57.227076 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1d5f1bfc-3e3f-4f2c-9865-3352ced55e07 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:57.239962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-62a4d559-837a-4b6b-96ff-88bdd0a55019 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:57.242033 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-62a4d559-837a-4b6b-96ff-88bdd0a55019 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:57.257034 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-62a4d559-837a-4b6b-96ff-88bdd0a55019 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:57.257532 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-62a4d559-837a-4b6b-96ff-88bdd0a55019 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:57.258360 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-62a4d559-837a-4b6b-96ff-88bdd0a55019 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:57.258796 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-62a4d559-837a-4b6b-96ff-88bdd0a55019 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:57.563363 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1d5f1bfc-3e3f-4f2c-9865-3352ced55e07 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:57.574142 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1d5f1bfc-3e3f-4f2c-9865-3352ced55e07 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1507 microversion: 2.1 time: 0.395935 Dec 16 14:42:57.578048 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 286/591] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:57 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1507 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:57.956291 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-62a4d559-837a-4b6b-96ff-88bdd0a55019 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:57.999233 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-62a4d559-837a-4b6b-96ff-88bdd0a55019 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1556 microversion: 2.1 time: 0.784902 Dec 16 14:42:58.000199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 306/592] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:57 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1556 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:59.034221 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9f6b6b14-b679-4d4e-b489-13d77135b871 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:59.035097 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9f6b6b14-b679-4d4e-b489-13d77135b871 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:42:59.043875 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9f6b6b14-b679-4d4e-b489-13d77135b871 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:59.044862 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9f6b6b14-b679-4d4e-b489-13d77135b871 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:59.045794 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9f6b6b14-b679-4d4e-b489-13d77135b871 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:59.046361 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9f6b6b14-b679-4d4e-b489-13d77135b871 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:59.316627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-b5cc3e78-b1ea-49a0-94fc-3ebaf4a20ab0 req-0e40b470-a4dd-4ad4-b4d3-e51523cfbcfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6e43c8-eea5-48d0-b7bf-ff18381a0f20", "tag": "a1de2547-6459-4d87-9d1f-a9adfc216809"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:59.324409 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:59.324409 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:42:59.335611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-b5cc3e78-b1ea-49a0-94fc-3ebaf4a20ab0 req-0e40b470-a4dd-4ad4-b4d3-e51523cfbcfe service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:59.336582 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-b5cc3e78-b1ea-49a0-94fc-3ebaf4a20ab0 req-0e40b470-a4dd-4ad4-b4d3-e51523cfbcfe service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:59.364459 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-b5cc3e78-b1ea-49a0-94fc-3ebaf4a20ab0 req-0e40b470-a4dd-4ad4-b4d3-e51523cfbcfe service nova] Creating event network-changed:a1de2547-6459-4d87-9d1f-a9adfc216809 for instance fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 on hv-cinder-82189 Dec 16 14:42:59.373635 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-b5cc3e78-b1ea-49a0-94fc-3ebaf4a20ab0 req-0e40b470-a4dd-4ad4-b4d3-e51523cfbcfe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065631 Dec 16 14:42:59.380107 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 307/593] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:59.469025 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9f6b6b14-b679-4d4e-b489-13d77135b871 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:42:59.482299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9f6b6b14-b679-4d4e-b489-13d77135b871 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1556 microversion: 2.1 time: 0.458666 Dec 16 14:42:59.484762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 287/594] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:59 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1556 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:00.517622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a9330043-7bed-44bc-a54a-5defc6aee278 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:00.518895 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a9330043-7bed-44bc-a54a-5defc6aee278 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:00.534412 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a9330043-7bed-44bc-a54a-5defc6aee278 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:00.535651 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a9330043-7bed-44bc-a54a-5defc6aee278 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:00.537048 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a9330043-7bed-44bc-a54a-5defc6aee278 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:00.537770 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a9330043-7bed-44bc-a54a-5defc6aee278 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:01.321927 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a9330043-7bed-44bc-a54a-5defc6aee278 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:01.336461 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a9330043-7bed-44bc-a54a-5defc6aee278 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1556 microversion: 2.1 time: 0.838388 Dec 16 14:43:01.338298 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 308/595] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:00 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1556 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:02.368004 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6cf75224-e327-4334-a85c-ab053d63453b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:02.369038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6cf75224-e327-4334-a85c-ab053d63453b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:02.383724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6cf75224-e327-4334-a85c-ab053d63453b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:02.385721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6cf75224-e327-4334-a85c-ab053d63453b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:02.387641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6cf75224-e327-4334-a85c-ab053d63453b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:02.388204 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6cf75224-e327-4334-a85c-ab053d63453b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:02.698678 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6cf75224-e327-4334-a85c-ab053d63453b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:02.714287 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6cf75224-e327-4334-a85c-ab053d63453b tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1562 microversion: 2.1 time: 0.358750 Dec 16 14:43:02.715202 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 288/596] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:02 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1562 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:02.890414 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ba1f380f-5f97-4164-a8c2-b68291388a26 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:02.891320 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ba1f380f-5f97-4164-a8c2-b68291388a26 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:02.899051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ba1f380f-5f97-4164-a8c2-b68291388a26 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:02.899526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ba1f380f-5f97-4164-a8c2-b68291388a26 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:02.900339 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ba1f380f-5f97-4164-a8c2-b68291388a26 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:02.900776 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ba1f380f-5f97-4164-a8c2-b68291388a26 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:03.117352 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d77e69f-3f23-436f-ac0f-bb2788c9393a] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 14:43:03.279424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ba1f380f-5f97-4164-a8c2-b68291388a26 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "DELETE /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments/7656ae02-9c74-4768-be6f-b3637280a988" status: 202 len: 0 microversion: 2.1 time: 0.398387 Dec 16 14:43:03.280388 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 309/597] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:43:02 2021] DELETE /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments/7656ae02-9c74-4768-be6f-b3637280a988 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:43:03.306556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e1f37511-583c-41c5-95b7-d54275e2d8d0 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:03.308579 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e1f37511-583c-41c5-95b7-d54275e2d8d0 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:03.329790 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e1f37511-583c-41c5-95b7-d54275e2d8d0 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:03.330599 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e1f37511-583c-41c5-95b7-d54275e2d8d0 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:03.331976 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e1f37511-583c-41c5-95b7-d54275e2d8d0 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:03.332664 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e1f37511-583c-41c5-95b7-d54275e2d8d0 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:03.468704 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e1f37511-583c-41c5-95b7-d54275e2d8d0 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181509 Dec 16 14:43:03.470218 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 289/598] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:03 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:04.518482 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d34bb45e-2e01-4121-a61c-abe2bf9f9bbf tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:04.520124 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d34bb45e-2e01-4121-a61c-abe2bf9f9bbf tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:04.537549 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d34bb45e-2e01-4121-a61c-abe2bf9f9bbf tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:04.538306 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d34bb45e-2e01-4121-a61c-abe2bf9f9bbf tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:04.539590 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d34bb45e-2e01-4121-a61c-abe2bf9f9bbf tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:04.540287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d34bb45e-2e01-4121-a61c-abe2bf9f9bbf tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:04.646381 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d77e69f-3f23-436f-ac0f-bb2788c9393a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 35770. Dec 16 14:43:04.684187 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d34bb45e-2e01-4121-a61c-abe2bf9f9bbf tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205323 Dec 16 14:43:04.685535 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 310/599] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:04 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:05.708587 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3d883410-4302-4fb7-b1f3-3dc60acd3455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:05.709517 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3d883410-4302-4fb7-b1f3-3dc60acd3455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:05.720163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3d883410-4302-4fb7-b1f3-3dc60acd3455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:05.720851 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3d883410-4302-4fb7-b1f3-3dc60acd3455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:05.722216 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3d883410-4302-4fb7-b1f3-3dc60acd3455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:05.722932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3d883410-4302-4fb7-b1f3-3dc60acd3455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:05.861551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3d883410-4302-4fb7-b1f3-3dc60acd3455 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.164893 Dec 16 14:43:05.862707 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 290/600] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:05 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:43:08.587267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4a62354b-575a-48f1-8b9c-2620588877ed tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:08.588160 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4a62354b-575a-48f1-8b9c-2620588877ed tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:08.601221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4a62354b-575a-48f1-8b9c-2620588877ed tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:08.602090 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4a62354b-575a-48f1-8b9c-2620588877ed tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:08.603621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4a62354b-575a-48f1-8b9c-2620588877ed tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:08.604454 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4a62354b-575a-48f1-8b9c-2620588877ed tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:08.740449 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4a62354b-575a-48f1-8b9c-2620588877ed tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Going to try to terminate instance {{(pid=96670) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:43:08.890840 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4a62354b-575a-48f1-8b9c-2620588877ed tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 204 len: 0 microversion: 2.1 time: 0.321747 Dec 16 14:43:08.892295 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 311/601] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:43:08 2021] DELETE /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:43:08.918273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-22d03228-a486-4592-8e48-5bbbae678481 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:08.919353 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-22d03228-a486-4592-8e48-5bbbae678481 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:08.933281 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-22d03228-a486-4592-8e48-5bbbae678481 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:08.934050 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-22d03228-a486-4592-8e48-5bbbae678481 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:08.935459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-22d03228-a486-4592-8e48-5bbbae678481 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:08.936362 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-22d03228-a486-4592-8e48-5bbbae678481 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:09.299913 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-22d03228-a486-4592-8e48-5bbbae678481 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:09.311768 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-22d03228-a486-4592-8e48-5bbbae678481 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1508 microversion: 2.1 time: 0.412917 Dec 16 14:43:09.312377 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 291/602] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:08 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:10.347175 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0a102987-a8a4-4e88-af0b-42d43576f667 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:10.348307 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0a102987-a8a4-4e88-af0b-42d43576f667 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:10.362503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0a102987-a8a4-4e88-af0b-42d43576f667 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:10.363246 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0a102987-a8a4-4e88-af0b-42d43576f667 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:10.364939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0a102987-a8a4-4e88-af0b-42d43576f667 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:10.365667 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0a102987-a8a4-4e88-af0b-42d43576f667 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:10.694656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0a102987-a8a4-4e88-af0b-42d43576f667 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:10.705033 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0a102987-a8a4-4e88-af0b-42d43576f667 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1508 microversion: 2.1 time: 0.376936 Dec 16 14:43:10.705679 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 312/603] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:10 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:11.738418 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7036f20a-dfea-4fc6-a003-d67a1b97c3ef tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:11.739784 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7036f20a-dfea-4fc6-a003-d67a1b97c3ef tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:11.747470 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7036f20a-dfea-4fc6-a003-d67a1b97c3ef tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:11.747914 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7036f20a-dfea-4fc6-a003-d67a1b97c3ef tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:11.748881 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7036f20a-dfea-4fc6-a003-d67a1b97c3ef tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:11.749288 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7036f20a-dfea-4fc6-a003-d67a1b97c3ef tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:11.995429 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7036f20a-dfea-4fc6-a003-d67a1b97c3ef tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:12.010480 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7036f20a-dfea-4fc6-a003-d67a1b97c3ef tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1508 microversion: 2.1 time: 0.281612 Dec 16 14:43:12.011374 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 292/604] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:11 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:13.051092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9dfbb49d-ba64-438c-91fe-c5f797cedfe5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:13.052111 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9dfbb49d-ba64-438c-91fe-c5f797cedfe5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:13.063753 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9dfbb49d-ba64-438c-91fe-c5f797cedfe5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:13.064337 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9dfbb49d-ba64-438c-91fe-c5f797cedfe5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:13.065332 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9dfbb49d-ba64-438c-91fe-c5f797cedfe5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:13.065868 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9dfbb49d-ba64-438c-91fe-c5f797cedfe5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:13.590128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9dfbb49d-ba64-438c-91fe-c5f797cedfe5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:13.608213 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9dfbb49d-ba64-438c-91fe-c5f797cedfe5 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1508 microversion: 2.1 time: 0.572080 Dec 16 14:43:13.612223 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 313/605] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:13 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1508 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:14.263297 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-663d8a99-e53c-4d2f-ace1-f2eda6af1e54 req-27fd0e85-c8a2-4a5e-a627-68ee207ae59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6662dea-31e0-4386-ab0f-3fe74bcf7ac0", "name": "network-vif-deleted", "tag": "9127d9e7-040f-4d49-ba17-2bc54c53879b"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:14.272372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:14.272372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:43:14.282383 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-663d8a99-e53c-4d2f-ace1-f2eda6af1e54 req-27fd0e85-c8a2-4a5e-a627-68ee207ae59e service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:14.282811 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-663d8a99-e53c-4d2f-ace1-f2eda6af1e54 req-27fd0e85-c8a2-4a5e-a627-68ee207ae59e service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:14.307781 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-663d8a99-e53c-4d2f-ace1-f2eda6af1e54 req-27fd0e85-c8a2-4a5e-a627-68ee207ae59e service nova] Creating event network-vif-deleted:9127d9e7-040f-4d49-ba17-2bc54c53879b for instance d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 on hv-cinder-82189 Dec 16 14:43:14.317663 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-663d8a99-e53c-4d2f-ace1-f2eda6af1e54 req-27fd0e85-c8a2-4a5e-a627-68ee207ae59e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068526 Dec 16 14:43:14.319085 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 293/606] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:14.645822 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:14.647275 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:14.657104 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:14.657798 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:14.658889 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:14.659424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:14.752378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:14.753050 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:14.753702 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lazy-loading 'fault' on Instance uuid d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:43:14.897518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:14.911854 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-97f9ab4f-d581-4b24-9e91-5b8b53a857ce tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 200 len: 1311 microversion: 2.1 time: 0.280325 Dec 16 14:43:14.913025 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 314/607] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:14 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 1311 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:15.954628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d1ef50ea-deab-408c-965c-3faf8f488dc2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:15.955779 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d1ef50ea-deab-408c-965c-3faf8f488dc2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: d6662dea-31e0-4386-ab0f-3fe74bcf7ac0] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:15.968420 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d1ef50ea-deab-408c-965c-3faf8f488dc2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:15.968860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d1ef50ea-deab-408c-965c-3faf8f488dc2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:15.970095 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d1ef50ea-deab-408c-965c-3faf8f488dc2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:15.970729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d1ef50ea-deab-408c-965c-3faf8f488dc2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:16.074278 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-d1ef50ea-deab-408c-965c-3faf8f488dc2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] HTTP exception thrown: Instance d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 could not be found. Dec 16 14:43:16.074278 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d1ef50ea-deab-408c-965c-3faf8f488dc2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Returning 404 to user: Instance d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:43:16.074988 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d1ef50ea-deab-408c-965c-3faf8f488dc2 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0" status: 404 len: 111 microversion: 2.1 time: 0.137411 Dec 16 14:43:16.076577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 294/608] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:15 2021] GET /compute/v2.1/servers/d6662dea-31e0-4386-ab0f-3fe74bcf7ac0 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:16.093339 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-094e493c-caf6-4bbb-a1e6-2a0f0578e67c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:16.094154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-094e493c-caf6-4bbb-a1e6-2a0f0578e67c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:16.105554 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-094e493c-caf6-4bbb-a1e6-2a0f0578e67c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:16.106296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-094e493c-caf6-4bbb-a1e6-2a0f0578e67c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:16.107617 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-094e493c-caf6-4bbb-a1e6-2a0f0578e67c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:16.108599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-094e493c-caf6-4bbb-a1e6-2a0f0578e67c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:16.247789 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-094e493c-caf6-4bbb-a1e6-2a0f0578e67c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Going to try to terminate instance {{(pid=96670) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:43:16.429436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-094e493c-caf6-4bbb-a1e6-2a0f0578e67c tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "DELETE /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 204 len: 0 microversion: 2.1 time: 0.345560 Dec 16 14:43:16.429983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 315/609] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:43:16 2021] DELETE /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:43:16.453490 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3bf29ce5-bc3c-4843-8d78-47eaf8e232bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:16.454646 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3bf29ce5-bc3c-4843-8d78-47eaf8e232bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:16.466752 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3bf29ce5-bc3c-4843-8d78-47eaf8e232bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:16.467356 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3bf29ce5-bc3c-4843-8d78-47eaf8e232bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:16.468919 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3bf29ce5-bc3c-4843-8d78-47eaf8e232bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:16.469716 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3bf29ce5-bc3c-4843-8d78-47eaf8e232bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:16.794670 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3bf29ce5-bc3c-4843-8d78-47eaf8e232bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:16.805648 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3bf29ce5-bc3c-4843-8d78-47eaf8e232bd tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.369853 Dec 16 14:43:16.806303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 295/610] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:16 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:17.831212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0911b34f-c28d-4679-90c9-5f20447cb2fe tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:17.832027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0911b34f-c28d-4679-90c9-5f20447cb2fe tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:17.840754 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0911b34f-c28d-4679-90c9-5f20447cb2fe tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:17.841221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0911b34f-c28d-4679-90c9-5f20447cb2fe tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:17.842091 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0911b34f-c28d-4679-90c9-5f20447cb2fe tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:17.842538 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0911b34f-c28d-4679-90c9-5f20447cb2fe tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:18.078837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0911b34f-c28d-4679-90c9-5f20447cb2fe tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:18.092007 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0911b34f-c28d-4679-90c9-5f20447cb2fe tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.271902 Dec 16 14:43:18.092633 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 316/611] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:17 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:19.121858 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-953e15db-bc39-44a4-b859-82da7aa85721 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:19.122863 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-953e15db-bc39-44a4-b859-82da7aa85721 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:19.132837 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-953e15db-bc39-44a4-b859-82da7aa85721 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:19.133470 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-953e15db-bc39-44a4-b859-82da7aa85721 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:19.134526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-953e15db-bc39-44a4-b859-82da7aa85721 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:19.135266 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-953e15db-bc39-44a4-b859-82da7aa85721 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:19.450273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-953e15db-bc39-44a4-b859-82da7aa85721 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:19.460275 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-953e15db-bc39-44a4-b859-82da7aa85721 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.354094 Dec 16 14:43:19.461008 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 296/612] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:19 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:20.497323 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-563dd912-0a5c-4097-b0de-257bcd3dc856 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:20.498523 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-563dd912-0a5c-4097-b0de-257bcd3dc856 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:20.513415 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-563dd912-0a5c-4097-b0de-257bcd3dc856 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:20.514233 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-563dd912-0a5c-4097-b0de-257bcd3dc856 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:20.516767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-563dd912-0a5c-4097-b0de-257bcd3dc856 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:20.517570 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-563dd912-0a5c-4097-b0de-257bcd3dc856 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:20.916915 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-563dd912-0a5c-4097-b0de-257bcd3dc856 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:20.927193 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-563dd912-0a5c-4097-b0de-257bcd3dc856 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.451066 Dec 16 14:43:20.927899 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 317/613] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:20 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:21.923360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e95d2e0e-68ec-451b-998a-98135661bce8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:21.924194 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e95d2e0e-68ec-451b-998a-98135661bce8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:21.939364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e95d2e0e-68ec-451b-998a-98135661bce8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:21.940119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e95d2e0e-68ec-451b-998a-98135661bce8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:21.941531 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e95d2e0e-68ec-451b-998a-98135661bce8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:21.942319 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e95d2e0e-68ec-451b-998a-98135661bce8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:21.962764 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-52791bf1-2ea7-43fb-a85d-5859c39f8743 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:21.963792 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-52791bf1-2ea7-43fb-a85d-5859c39f8743 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:21.977479 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-52791bf1-2ea7-43fb-a85d-5859c39f8743 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:21.978317 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-52791bf1-2ea7-43fb-a85d-5859c39f8743 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:21.979765 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-52791bf1-2ea7-43fb-a85d-5859c39f8743 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:21.980598 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-52791bf1-2ea7-43fb-a85d-5859c39f8743 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:22.303390 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-52791bf1-2ea7-43fb-a85d-5859c39f8743 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:22.319497 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-52791bf1-2ea7-43fb-a85d-5859c39f8743 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.375834 Dec 16 14:43:22.320533 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 318/614] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:21 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:22.357859 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e95d2e0e-68ec-451b-998a-98135661bce8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/os-volume_attachments/a2bdc85b-7b6e-433d-b2aa-8f4ee811896e" status: 202 len: 0 microversion: 2.1 time: 0.743419 Dec 16 14:43:22.360113 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 297/615] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:43:21 2021] DELETE /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/os-volume_attachments/a2bdc85b-7b6e-433d-b2aa-8f4ee811896e => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:43:23.358522 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e44b1e54-6284-48b4-a0dc-004641ff8efa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:23.361401 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e44b1e54-6284-48b4-a0dc-004641ff8efa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:23.375948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e44b1e54-6284-48b4-a0dc-004641ff8efa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:23.376741 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e44b1e54-6284-48b4-a0dc-004641ff8efa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:23.378236 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e44b1e54-6284-48b4-a0dc-004641ff8efa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:23.379016 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e44b1e54-6284-48b4-a0dc-004641ff8efa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:23.751029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e44b1e54-6284-48b4-a0dc-004641ff8efa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:23.763298 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e44b1e54-6284-48b4-a0dc-004641ff8efa tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.424335 Dec 16 14:43:23.763842 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 319/616] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:23 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:24.799860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9d167d65-c66e-4d51-9847-ceacc32925a7 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:24.800843 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9d167d65-c66e-4d51-9847-ceacc32925a7 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:24.813954 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9d167d65-c66e-4d51-9847-ceacc32925a7 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:24.814797 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9d167d65-c66e-4d51-9847-ceacc32925a7 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:24.816373 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9d167d65-c66e-4d51-9847-ceacc32925a7 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:24.817159 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9d167d65-c66e-4d51-9847-ceacc32925a7 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:24.921951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b333149c-7644-4233-81f9-f043d8bd710b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:24.932821 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b333149c-7644-4233-81f9-f043d8bd710b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:24.933723 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b333149c-7644-4233-81f9-f043d8bd710b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:25.006234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b333149c-7644-4233-81f9-f043d8bd710b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Going to try to stop instance {{(pid=96670) force_stop /opt/stack/nova/nova/compute/api.py:2599}} Dec 16 14:43:25.171349 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b333149c-7644-4233-81f9-f043d8bd710b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 202 len: 0 microversion: 2.1 time: 0.256393 Dec 16 14:43:25.179429 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 320/617] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:43:24 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:43:25.254964 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8e8da3c4-70f5-4a47-a2af-4b0502c9e6d9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:25.257152 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8e8da3c4-70f5-4a47-a2af-4b0502c9e6d9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:25.289080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e8da3c4-70f5-4a47-a2af-4b0502c9e6d9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:25.290839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e8da3c4-70f5-4a47-a2af-4b0502c9e6d9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:25.293122 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e8da3c4-70f5-4a47-a2af-4b0502c9e6d9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:25.296495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8e8da3c4-70f5-4a47-a2af-4b0502c9e6d9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:25.344271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9d167d65-c66e-4d51-9847-ceacc32925a7 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c9d652402e4465b4820436357bdc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2109a7078ee45b1b922e81c997328cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:25.384699 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9d167d65-c66e-4d51-9847-ceacc32925a7 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 200 len: 1522 microversion: 2.1 time: 0.593744 Dec 16 14:43:25.392121 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 298/618] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:24 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:25.417429 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-092f31dc-9479-4ba6-872b-c31f5b6f322f req-878c53c5-5332-4274-8626-be720b787aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618e7310-603e-4003-b2d6-b05eb18cd558", "name": "network-vif-deleted", "tag": "a57d57e1-1c2b-4139-ae4f-0870a2d2619a"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:25.435578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:25.435578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:43:25.454619 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-092f31dc-9479-4ba6-872b-c31f5b6f322f req-878c53c5-5332-4274-8626-be720b787aa4 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:25.455709 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-092f31dc-9479-4ba6-872b-c31f5b6f322f req-878c53c5-5332-4274-8626-be720b787aa4 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:25.487373 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-092f31dc-9479-4ba6-872b-c31f5b6f322f req-878c53c5-5332-4274-8626-be720b787aa4 service nova] Creating event network-vif-deleted:a57d57e1-1c2b-4139-ae4f-0870a2d2619a for instance 618e7310-603e-4003-b2d6-b05eb18cd558 on hv-cinder-82189 Dec 16 14:43:25.493151 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-092f31dc-9479-4ba6-872b-c31f5b6f322f req-878c53c5-5332-4274-8626-be720b787aa4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098875 Dec 16 14:43:25.493761 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 299/619] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:25.631950 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8e8da3c4-70f5-4a47-a2af-4b0502c9e6d9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:25.643217 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8e8da3c4-70f5-4a47-a2af-4b0502c9e6d9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.461472 Dec 16 14:43:25.644073 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 321/620] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:25 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:26.411789 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9ca5fb1e-aff5-4b87-9a64-8f149b83ed25 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:26.412510 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9ca5fb1e-aff5-4b87-9a64-8f149b83ed25 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] [instance: 618e7310-603e-4003-b2d6-b05eb18cd558] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:26.421306 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ca5fb1e-aff5-4b87-9a64-8f149b83ed25 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:26.421306 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ca5fb1e-aff5-4b87-9a64-8f149b83ed25 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:26.422267 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ca5fb1e-aff5-4b87-9a64-8f149b83ed25 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:26.422446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9ca5fb1e-aff5-4b87-9a64-8f149b83ed25 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:26.519378 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-9ca5fb1e-aff5-4b87-9a64-8f149b83ed25 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] HTTP exception thrown: Instance 618e7310-603e-4003-b2d6-b05eb18cd558 could not be found. Dec 16 14:43:26.520048 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9ca5fb1e-aff5-4b87-9a64-8f149b83ed25 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] Returning 404 to user: Instance 618e7310-603e-4003-b2d6-b05eb18cd558 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:43:26.520946 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9ca5fb1e-aff5-4b87-9a64-8f149b83ed25 tempest-ServerRescueNegativeTestJSON-472365318 tempest-ServerRescueNegativeTestJSON-472365318-project] 10.222.0.67 "GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558" status: 404 len: 111 microversion: 2.1 time: 0.119423 Dec 16 14:43:26.521537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 300/621] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:26 2021] GET /compute/v2.1/servers/618e7310-603e-4003-b2d6-b05eb18cd558 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:26.686060 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b3e86a5a-880d-4ca8-9785-b1d4a29c7589 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:26.688667 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b3e86a5a-880d-4ca8-9785-b1d4a29c7589 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:26.701893 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b3e86a5a-880d-4ca8-9785-b1d4a29c7589 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:26.702648 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b3e86a5a-880d-4ca8-9785-b1d4a29c7589 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:26.704063 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b3e86a5a-880d-4ca8-9785-b1d4a29c7589 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:26.704756 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b3e86a5a-880d-4ca8-9785-b1d4a29c7589 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:27.080660 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b3e86a5a-880d-4ca8-9785-b1d4a29c7589 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:27.089869 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b3e86a5a-880d-4ca8-9785-b1d4a29c7589 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.426196 Dec 16 14:43:27.090494 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 322/622] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:26 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:28.133088 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d88467cc-5c00-4684-8e9d-550b53a9fdfa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:28.134482 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d88467cc-5c00-4684-8e9d-550b53a9fdfa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:28.149098 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d88467cc-5c00-4684-8e9d-550b53a9fdfa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:28.149833 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d88467cc-5c00-4684-8e9d-550b53a9fdfa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:28.151304 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d88467cc-5c00-4684-8e9d-550b53a9fdfa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:28.152149 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d88467cc-5c00-4684-8e9d-550b53a9fdfa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:28.513324 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d88467cc-5c00-4684-8e9d-550b53a9fdfa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:28.531671 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d88467cc-5c00-4684-8e9d-550b53a9fdfa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.422420 Dec 16 14:43:28.533598 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 301/623] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:28 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:29.560420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-024d02bb-af79-4384-bacb-58944da2d17c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:29.561305 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-024d02bb-af79-4384-bacb-58944da2d17c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:29.571495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-024d02bb-af79-4384-bacb-58944da2d17c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:29.572034 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-024d02bb-af79-4384-bacb-58944da2d17c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:29.573021 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-024d02bb-af79-4384-bacb-58944da2d17c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:29.573521 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-024d02bb-af79-4384-bacb-58944da2d17c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:30.166961 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-024d02bb-af79-4384-bacb-58944da2d17c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:30.183736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-024d02bb-af79-4384-bacb-58944da2d17c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.634073 Dec 16 14:43:30.184519 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 323/624] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:29 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:31.218770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-61c0e0ef-75ee-4767-ad4d-bba0b516db1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:31.220300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-61c0e0ef-75ee-4767-ad4d-bba0b516db1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:31.230997 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-61c0e0ef-75ee-4767-ad4d-bba0b516db1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:31.231774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-61c0e0ef-75ee-4767-ad4d-bba0b516db1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:31.233000 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-61c0e0ef-75ee-4767-ad4d-bba0b516db1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:31.233567 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-61c0e0ef-75ee-4767-ad4d-bba0b516db1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:31.535257 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-61c0e0ef-75ee-4767-ad4d-bba0b516db1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:31.549549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-61c0e0ef-75ee-4767-ad4d-bba0b516db1d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.348633 Dec 16 14:43:31.559995 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 302/625] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:31 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:32.587384 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4703fdf8-59ca-426c-bbf5-fbc2ab2499b2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:32.588798 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4703fdf8-59ca-426c-bbf5-fbc2ab2499b2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:32.603500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4703fdf8-59ca-426c-bbf5-fbc2ab2499b2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:32.604276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4703fdf8-59ca-426c-bbf5-fbc2ab2499b2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:32.605694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4703fdf8-59ca-426c-bbf5-fbc2ab2499b2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:32.606479 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4703fdf8-59ca-426c-bbf5-fbc2ab2499b2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:33.151053 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4703fdf8-59ca-426c-bbf5-fbc2ab2499b2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:33.188747 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4703fdf8-59ca-426c-bbf5-fbc2ab2499b2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.623352 Dec 16 14:43:33.198156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 324/626] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:32 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:34.219935 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e4377a02-01a8-43c5-819c-8b6e5543553a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:34.220890 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e4377a02-01a8-43c5-819c-8b6e5543553a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:34.233333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4377a02-01a8-43c5-819c-8b6e5543553a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:34.233860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4377a02-01a8-43c5-819c-8b6e5543553a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:34.235420 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4377a02-01a8-43c5-819c-8b6e5543553a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:34.236055 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4377a02-01a8-43c5-819c-8b6e5543553a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:34.612163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e4377a02-01a8-43c5-819c-8b6e5543553a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:34.622249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e4377a02-01a8-43c5-819c-8b6e5543553a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.419529 Dec 16 14:43:34.622942 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 303/627] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:34 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:35.663532 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4b8b847f-4be6-40eb-b6cb-37d4a0fb7dfc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:35.664669 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4b8b847f-4be6-40eb-b6cb-37d4a0fb7dfc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:35.677275 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4b8b847f-4be6-40eb-b6cb-37d4a0fb7dfc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:35.677976 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4b8b847f-4be6-40eb-b6cb-37d4a0fb7dfc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:35.679260 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4b8b847f-4be6-40eb-b6cb-37d4a0fb7dfc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:35.679948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4b8b847f-4be6-40eb-b6cb-37d4a0fb7dfc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:36.059829 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4b8b847f-4be6-40eb-b6cb-37d4a0fb7dfc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:36.075269 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4b8b847f-4be6-40eb-b6cb-37d4a0fb7dfc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.431301 Dec 16 14:43:36.076248 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 325/628] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:35 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:37.116782 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8697563f-4e81-4435-9a3f-adfb27bad694 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:37.116782 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8697563f-4e81-4435-9a3f-adfb27bad694 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:37.128670 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8697563f-4e81-4435-9a3f-adfb27bad694 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:37.129437 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8697563f-4e81-4435-9a3f-adfb27bad694 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:37.130815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8697563f-4e81-4435-9a3f-adfb27bad694 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:37.131780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8697563f-4e81-4435-9a3f-adfb27bad694 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:37.491328 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8697563f-4e81-4435-9a3f-adfb27bad694 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:37.503903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8697563f-4e81-4435-9a3f-adfb27bad694 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.411484 Dec 16 14:43:37.504765 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 304/629] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:37 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:38.538394 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-dc79193e-0275-40b1-b553-f155e4d6e45e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:38.539634 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-dc79193e-0275-40b1-b553-f155e4d6e45e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:38.549891 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dc79193e-0275-40b1-b553-f155e4d6e45e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.550477 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dc79193e-0275-40b1-b553-f155e4d6e45e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.551343 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dc79193e-0275-40b1-b553-f155e4d6e45e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.551814 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dc79193e-0275-40b1-b553-f155e4d6e45e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.841459 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-dc79193e-0275-40b1-b553-f155e4d6e45e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:38.857642 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-dc79193e-0275-40b1-b553-f155e4d6e45e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.334070 Dec 16 14:43:38.858599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 326/630] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:38 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:39.890286 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-34b6b5aa-54a7-47de-99e6-5f988c9137ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:39.891065 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-34b6b5aa-54a7-47de-99e6-5f988c9137ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:39.900006 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34b6b5aa-54a7-47de-99e6-5f988c9137ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:39.900595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34b6b5aa-54a7-47de-99e6-5f988c9137ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:39.901455 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34b6b5aa-54a7-47de-99e6-5f988c9137ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:39.901872 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34b6b5aa-54a7-47de-99e6-5f988c9137ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:40.277534 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-34b6b5aa-54a7-47de-99e6-5f988c9137ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:40.288176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-34b6b5aa-54a7-47de-99e6-5f988c9137ca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1678 microversion: 2.1 time: 0.410438 Dec 16 14:43:40.288810 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 305/631] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:39 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1678 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:41.324387 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9971e6ec-34d3-4d5f-9423-bc21bd91ce93 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:41.325566 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9971e6ec-34d3-4d5f-9423-bc21bd91ce93 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:41.339159 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9971e6ec-34d3-4d5f-9423-bc21bd91ce93 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:41.340310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9971e6ec-34d3-4d5f-9423-bc21bd91ce93 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:41.341717 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9971e6ec-34d3-4d5f-9423-bc21bd91ce93 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:41.342724 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9971e6ec-34d3-4d5f-9423-bc21bd91ce93 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:41.720129 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9971e6ec-34d3-4d5f-9423-bc21bd91ce93 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:41.745755 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9971e6ec-34d3-4d5f-9423-bc21bd91ce93 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1655 microversion: 2.1 time: 0.440161 Dec 16 14:43:41.746461 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 327/632] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:41 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1655 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:41.774621 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fde7ca9d-14e0-4d1a-ab6e-537e2cc3a6b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:41.784861 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fde7ca9d-14e0-4d1a-ab6e-537e2cc3a6b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:41.785758 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fde7ca9d-14e0-4d1a-ab6e-537e2cc3a6b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:41.867569 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fde7ca9d-14e0-4d1a-ab6e-537e2cc3a6b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Going to try to start instance {{(pid=96669) start /opt/stack/nova/nova/compute/api.py:2622}} Dec 16 14:43:41.976787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fde7ca9d-14e0-4d1a-ab6e-537e2cc3a6b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action" status: 202 len: 0 microversion: 2.1 time: 0.214452 Dec 16 14:43:41.981248 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 306/633] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:43:41 2021] POST /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:43:41.995162 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-80e5a02e-91a3-4448-b13b-171e0b367d49 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:41.996705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-80e5a02e-91a3-4448-b13b-171e0b367d49 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:42.007201 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-80e5a02e-91a3-4448-b13b-171e0b367d49 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:42.007821 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-80e5a02e-91a3-4448-b13b-171e0b367d49 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:42.008722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-80e5a02e-91a3-4448-b13b-171e0b367d49 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:42.009324 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-80e5a02e-91a3-4448-b13b-171e0b367d49 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:42.243824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-80e5a02e-91a3-4448-b13b-171e0b367d49 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:42.254177 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-80e5a02e-91a3-4448-b13b-171e0b367d49 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1664 microversion: 2.1 time: 0.271230 Dec 16 14:43:42.254832 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 328/634] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:41 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1664 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:43.291118 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-29d2d601-3881-47fa-bffd-a969e40f7ec5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:43.292489 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-29d2d601-3881-47fa-bffd-a969e40f7ec5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:43.306998 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-29d2d601-3881-47fa-bffd-a969e40f7ec5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:43.307770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-29d2d601-3881-47fa-bffd-a969e40f7ec5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:43.309086 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-29d2d601-3881-47fa-bffd-a969e40f7ec5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:43.309843 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-29d2d601-3881-47fa-bffd-a969e40f7ec5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:43.600985 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-29d2d601-3881-47fa-bffd-a969e40f7ec5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:43.611487 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-29d2d601-3881-47fa-bffd-a969e40f7ec5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1664 microversion: 2.1 time: 0.340955 Dec 16 14:43:43.612465 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 307/635] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:43 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1664 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:43.831372 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0bec6b2f-3ac8-44b2-831b-ea7d8c2a2fc0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b70cb7c-f20b-4279-9723-8fecf5bc40e0", "device": "/dev/sdb"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:43.833830 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0bec6b2f-3ac8-44b2-831b-ea7d8c2a2fc0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:43.844246 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0bec6b2f-3ac8-44b2-831b-ea7d8c2a2fc0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:43.845286 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0bec6b2f-3ac8-44b2-831b-ea7d8c2a2fc0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:43.846702 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0bec6b2f-3ac8-44b2-831b-ea7d8c2a2fc0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:43.847529 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0bec6b2f-3ac8-44b2-831b-ea7d8c2a2fc0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:44.565977 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0bec6b2f-3ac8-44b2-831b-ea7d8c2a2fc0 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "POST /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750901 Dec 16 14:43:44.567273 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 329/636] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:43:43 2021] POST /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8/os-volume_attachments => generated 194 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:44.646126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c55efe33-8f77-4725-8c9e-a61f208f45d6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:44.648801 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c55efe33-8f77-4725-8c9e-a61f208f45d6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:43:44.661829 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c55efe33-8f77-4725-8c9e-a61f208f45d6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:44.662687 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c55efe33-8f77-4725-8c9e-a61f208f45d6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:44.664209 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c55efe33-8f77-4725-8c9e-a61f208f45d6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:44.665011 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c55efe33-8f77-4725-8c9e-a61f208f45d6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:45.022954 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c55efe33-8f77-4725-8c9e-a61f208f45d6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:43:45.033176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c55efe33-8f77-4725-8c9e-a61f208f45d6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1668 microversion: 2.1 time: 0.400772 Dec 16 14:43:45.034239 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 308/637] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:44 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1668 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:44:28.220357 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3304fef0-3620-49cf-a009-192872e75a86 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:28.221370 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3304fef0-3620-49cf-a009-192872e75a86 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:28.236687 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3304fef0-3620-49cf-a009-192872e75a86 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:28.237222 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3304fef0-3620-49cf-a009-192872e75a86 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:28.238077 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3304fef0-3620-49cf-a009-192872e75a86 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:28.238512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3304fef0-3620-49cf-a009-192872e75a86 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:28.678550 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3304fef0-3620-49cf-a009-192872e75a86 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8/os-volume_attachments/2b70cb7c-f20b-4279-9723-8fecf5bc40e0" status: 202 len: 0 microversion: 2.1 time: 0.469110 Dec 16 14:44:28.679502 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 330/638] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:44:28 2021] DELETE /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8/os-volume_attachments/2b70cb7c-f20b-4279-9723-8fecf5bc40e0 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:44:30.046410 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2268f2f9-da3e-4084-be51-ec2e740cc09f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:30.047476 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2268f2f9-da3e-4084-be51-ec2e740cc09f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:30.056318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2268f2f9-da3e-4084-be51-ec2e740cc09f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:30.056678 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2268f2f9-da3e-4084-be51-ec2e740cc09f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:30.057782 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2268f2f9-da3e-4084-be51-ec2e740cc09f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:30.059022 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2268f2f9-da3e-4084-be51-ec2e740cc09f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:30.169620 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2268f2f9-da3e-4084-be51-ec2e740cc09f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:44:30.365104 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2268f2f9-da3e-4084-be51-ec2e740cc09f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 204 len: 0 microversion: 2.1 time: 0.331317 Dec 16 14:44:30.365839 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 309/639] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:44:30 2021] DELETE /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:44:30.387939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3f4a8bbf-beb0-4b4b-b4bf-4d1254e5535c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:30.389120 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3f4a8bbf-beb0-4b4b-b4bf-4d1254e5535c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:30.403332 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3f4a8bbf-beb0-4b4b-b4bf-4d1254e5535c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:30.404051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3f4a8bbf-beb0-4b4b-b4bf-4d1254e5535c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:30.405695 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3f4a8bbf-beb0-4b4b-b4bf-4d1254e5535c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:30.406713 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3f4a8bbf-beb0-4b4b-b4bf-4d1254e5535c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:30.906761 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3f4a8bbf-beb0-4b4b-b4bf-4d1254e5535c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:30.923362 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3f4a8bbf-beb0-4b4b-b4bf-4d1254e5535c tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1513 microversion: 2.1 time: 0.550060 Dec 16 14:44:30.924690 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 331/640] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:30 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1513 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:31.968884 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b52fd162-d255-49b5-b425-3d2ba34bb12d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:31.969671 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b52fd162-d255-49b5-b425-3d2ba34bb12d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:31.978982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b52fd162-d255-49b5-b425-3d2ba34bb12d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:31.979636 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b52fd162-d255-49b5-b425-3d2ba34bb12d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:31.980687 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b52fd162-d255-49b5-b425-3d2ba34bb12d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:31.981255 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b52fd162-d255-49b5-b425-3d2ba34bb12d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:32.275551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b52fd162-d255-49b5-b425-3d2ba34bb12d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:32.283944 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b52fd162-d255-49b5-b425-3d2ba34bb12d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1513 microversion: 2.1 time: 0.327973 Dec 16 14:44:32.294558 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 310/641] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:31 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1513 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:33.310362 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9195abca-00e2-4a2c-9512-6ec1e7bcf77d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:33.311918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9195abca-00e2-4a2c-9512-6ec1e7bcf77d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:33.321372 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9195abca-00e2-4a2c-9512-6ec1e7bcf77d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:33.321583 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9195abca-00e2-4a2c-9512-6ec1e7bcf77d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:33.322772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9195abca-00e2-4a2c-9512-6ec1e7bcf77d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:33.323048 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9195abca-00e2-4a2c-9512-6ec1e7bcf77d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:34.186416 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9195abca-00e2-4a2c-9512-6ec1e7bcf77d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:34.203498 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9195abca-00e2-4a2c-9512-6ec1e7bcf77d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 200 len: 1513 microversion: 2.1 time: 0.903707 Dec 16 14:44:34.219034 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 332/642] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:33 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 1513 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:34.557465 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-2bcf4ce9-3a4f-4ea4-99ec-7016e3460fcc req-be004cc1-367c-4b7d-87ee-92b6f6072337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8", "name": "network-vif-deleted", "tag": "e2d3277a-945e-4ae4-95c3-d817894dc3e0"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:34.580074 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:44:34.580074 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:44:34.610197 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-2bcf4ce9-3a4f-4ea4-99ec-7016e3460fcc req-be004cc1-367c-4b7d-87ee-92b6f6072337 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:34.611683 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-2bcf4ce9-3a4f-4ea4-99ec-7016e3460fcc req-be004cc1-367c-4b7d-87ee-92b6f6072337 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:34.648398 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-2bcf4ce9-3a4f-4ea4-99ec-7016e3460fcc req-be004cc1-367c-4b7d-87ee-92b6f6072337 service nova] Creating event network-vif-deleted:e2d3277a-945e-4ae4-95c3-d817894dc3e0 for instance f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 on hv-cinder-82189 Dec 16 14:44:34.661284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-2bcf4ce9-3a4f-4ea4-99ec-7016e3460fcc req-be004cc1-367c-4b7d-87ee-92b6f6072337 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.465104 Dec 16 14:44:34.663795 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 311/643] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:44:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:44:35.235393 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-68dcafb9-1c08-464e-be86-1ca1bb935dcf tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:35.237400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-68dcafb9-1c08-464e-be86-1ca1bb935dcf tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:35.249753 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-68dcafb9-1c08-464e-be86-1ca1bb935dcf tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:35.251008 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-68dcafb9-1c08-464e-be86-1ca1bb935dcf tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:35.252875 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-68dcafb9-1c08-464e-be86-1ca1bb935dcf tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:35.254229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-68dcafb9-1c08-464e-be86-1ca1bb935dcf tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:35.545668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-68dcafb9-1c08-464e-be86-1ca1bb935dcf tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] HTTP exception thrown: Instance f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 could not be found. Dec 16 14:44:35.546332 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-68dcafb9-1c08-464e-be86-1ca1bb935dcf tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Returning 404 to user: Instance f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:44:35.547425 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-68dcafb9-1c08-464e-be86-1ca1bb935dcf tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8" status: 404 len: 111 microversion: 2.1 time: 0.327355 Dec 16 14:44:35.548501 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 333/644] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:35 2021] GET /compute/v2.1/servers/f816138f-14ea-4ad8-9ffc-70d6ef7fd3f8 => generated 111 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:44:48.021036 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:44:48.021036 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: Thu Dec 16 14:44:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.67) !!! Dec 16 14:44:48.043131 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1946528122", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "networks": [{"uuid": "44ed6d9d-119a-453b-8449-3d06aaf1b554"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:48.145070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] validate_networks() for [('44ed6d9d-119a-453b-8449-3d06aaf1b554', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:44:49.109433 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:44:49.111049 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:44:49.112883 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:44:49.113979 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:44:49.116826 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:44:49.136597 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:49.138703 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:49.140493 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:49.141681 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:49.193087 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Getting quotas for project 841e959321694bbe969318fafd7f676b. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:44:49.198685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Getting quotas for user 62521c33250d4e528a7c1edd5c0dda0b and project 841e959321694bbe969318fafd7f676b. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:44:49.211625 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:44:49.214592 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:44:49.274711 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d5578017-e8b3-4607-b204-21b8441d678f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254578 Dec 16 14:44:49.275681 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 312/645] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:44:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:44:49.315410 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-12d0f03c-6cb2-445c-9054-c45afd2f552f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:49.324507 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-12d0f03c-6cb2-445c-9054-c45afd2f552f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:49.336126 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:44:49.336400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: Thu Dec 16 14:44:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 (ip 10.222.0.67) !!! Dec 16 14:44:49.588236 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-12d0f03c-6cb2-445c-9054-c45afd2f552f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:49.605220 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-12d0f03c-6cb2-445c-9054-c45afd2f552f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1219 microversion: 2.1 time: 0.321957 Dec 16 14:44:49.607267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 334/646] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:49 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1219 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:50.644876 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-48fdace5-25db-4c12-82c0-804ba8482314 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:50.646187 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-48fdace5-25db-4c12-82c0-804ba8482314 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:50.816525 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-48fdace5-25db-4c12-82c0-804ba8482314 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:50.828426 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-48fdace5-25db-4c12-82c0-804ba8482314 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1219 microversion: 2.1 time: 0.206801 Dec 16 14:44:50.829481 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 313/647] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:50 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:51.894665 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-27b08d02-b453-481f-bb8b-6bdc00b96a71 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:51.896910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-27b08d02-b453-481f-bb8b-6bdc00b96a71 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:51.928341 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27b08d02-b453-481f-bb8b-6bdc00b96a71 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:51.929877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27b08d02-b453-481f-bb8b-6bdc00b96a71 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:51.932006 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27b08d02-b453-481f-bb8b-6bdc00b96a71 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:51.933186 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27b08d02-b453-481f-bb8b-6bdc00b96a71 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:52.224451 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-27b08d02-b453-481f-bb8b-6bdc00b96a71 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:52.234436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-27b08d02-b453-481f-bb8b-6bdc00b96a71 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1289 microversion: 2.1 time: 0.383336 Dec 16 14:44:52.235096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 335/648] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:51 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1289 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:53.272208 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-081ea578-755e-4614-aa58-88df6909ffb1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:53.273596 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-081ea578-755e-4614-aa58-88df6909ffb1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:53.283979 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-081ea578-755e-4614-aa58-88df6909ffb1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:53.284675 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-081ea578-755e-4614-aa58-88df6909ffb1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:53.285663 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-081ea578-755e-4614-aa58-88df6909ffb1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:53.286352 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-081ea578-755e-4614-aa58-88df6909ffb1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:53.677274 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-081ea578-755e-4614-aa58-88df6909ffb1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:53.688309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-081ea578-755e-4614-aa58-88df6909ffb1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1319 microversion: 2.1 time: 0.436881 Dec 16 14:44:53.689348 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 314/649] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:53 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:54.714061 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d1a983e3-c3ec-4369-ae0c-ef37e9c81df9 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:54.714607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d1a983e3-c3ec-4369-ae0c-ef37e9c81df9 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:54.744478 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1a983e3-c3ec-4369-ae0c-ef37e9c81df9 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:54.744918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1a983e3-c3ec-4369-ae0c-ef37e9c81df9 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:54.751216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1a983e3-c3ec-4369-ae0c-ef37e9c81df9 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:54.751914 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d1a983e3-c3ec-4369-ae0c-ef37e9c81df9 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:54.791772 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-acc9e06a-0476-43a9-855e-6f0c6e542ce5 req-5558a2a8-3a5f-4d5d-b42b-0e145b0441a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1747dc01-042a-43ca-af34-0f592eb34e76", "tag": "61d17c21-dd75-4cdb-8c24-c439e4185bf1"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:54.823920 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:44:54.823920 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:44:54.845731 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-acc9e06a-0476-43a9-855e-6f0c6e542ce5 req-5558a2a8-3a5f-4d5d-b42b-0e145b0441a5 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:54.849741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-acc9e06a-0476-43a9-855e-6f0c6e542ce5 req-5558a2a8-3a5f-4d5d-b42b-0e145b0441a5 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:54.892349 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-acc9e06a-0476-43a9-855e-6f0c6e542ce5 req-5558a2a8-3a5f-4d5d-b42b-0e145b0441a5 service nova] Creating event network-changed:61d17c21-dd75-4cdb-8c24-c439e4185bf1 for instance 1747dc01-042a-43ca-af34-0f592eb34e76 on hv-cinder-82189 Dec 16 14:44:54.921253 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-acc9e06a-0476-43a9-855e-6f0c6e542ce5 req-5558a2a8-3a5f-4d5d-b42b-0e145b0441a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140522 Dec 16 14:44:54.923042 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 315/650] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:44:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:44:55.432949 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d1a983e3-c3ec-4369-ae0c-ef37e9c81df9 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:55.450563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d1a983e3-c3ec-4369-ae0c-ef37e9c81df9 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1319 microversion: 2.1 time: 0.746655 Dec 16 14:44:55.453420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 336/651] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:54 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1319 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:56.570238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-77665864-2308-4a7f-a518-479160bbd1a3 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:56.571675 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-77665864-2308-4a7f-a518-479160bbd1a3 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:56.581038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77665864-2308-4a7f-a518-479160bbd1a3 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:56.582172 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77665864-2308-4a7f-a518-479160bbd1a3 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:56.583744 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77665864-2308-4a7f-a518-479160bbd1a3 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:56.586983 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-77665864-2308-4a7f-a518-479160bbd1a3 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:56.988266 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-77665864-2308-4a7f-a518-479160bbd1a3 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:57.076293 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-77665864-2308-4a7f-a518-479160bbd1a3 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1319 microversion: 2.1 time: 0.595486 Dec 16 14:44:57.090629 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 316/652] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:56 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:58.116831 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c4d57396-b116-4a75-a258-f76891da524a tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:58.119346 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c4d57396-b116-4a75-a258-f76891da524a tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:58.134369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c4d57396-b116-4a75-a258-f76891da524a tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:58.140618 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c4d57396-b116-4a75-a258-f76891da524a tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:58.142441 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c4d57396-b116-4a75-a258-f76891da524a tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:58.143423 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c4d57396-b116-4a75-a258-f76891da524a tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:58.460387 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c4d57396-b116-4a75-a258-f76891da524a tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:44:58.472763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c4d57396-b116-4a75-a258-f76891da524a tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1319 microversion: 2.1 time: 0.372170 Dec 16 14:44:58.474223 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 337/653] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:58 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:59.516896 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cff9d8bc-31d8-4754-a286-2d0c09688dd1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:59.524002 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cff9d8bc-31d8-4754-a286-2d0c09688dd1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:44:59.541416 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d120072-e536-428c-9013-c2f8ecacc31c] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 14:44:59.544378 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cff9d8bc-31d8-4754-a286-2d0c09688dd1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:59.545547 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cff9d8bc-31d8-4754-a286-2d0c09688dd1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:59.547280 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cff9d8bc-31d8-4754-a286-2d0c09688dd1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:59.548230 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cff9d8bc-31d8-4754-a286-2d0c09688dd1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:00.043314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cff9d8bc-31d8-4754-a286-2d0c09688dd1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:00.059988 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cff9d8bc-31d8-4754-a286-2d0c09688dd1 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1319 microversion: 2.1 time: 0.559099 Dec 16 14:45:00.077650 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 317/654] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:59 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1319 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:01.116574 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8d264f12-9689-4c7e-a367-6949729e988d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:01.118050 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8d264f12-9689-4c7e-a367-6949729e988d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:01.160943 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8d264f12-9689-4c7e-a367-6949729e988d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:01.164439 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8d264f12-9689-4c7e-a367-6949729e988d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:01.168157 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8d264f12-9689-4c7e-a367-6949729e988d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:01.168969 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8d264f12-9689-4c7e-a367-6949729e988d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:01.620147 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8d264f12-9689-4c7e-a367-6949729e988d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:01.632788 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8d264f12-9689-4c7e-a367-6949729e988d tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1319 microversion: 2.1 time: 0.547643 Dec 16 14:45:01.633700 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 338/655] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:01 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1319 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:02.668124 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2eab65f5-5624-44c5-a408-6e9039583378 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:02.669478 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2eab65f5-5624-44c5-a408-6e9039583378 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:02.690038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2eab65f5-5624-44c5-a408-6e9039583378 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:02.690812 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2eab65f5-5624-44c5-a408-6e9039583378 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:02.691897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2eab65f5-5624-44c5-a408-6e9039583378 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:02.692579 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2eab65f5-5624-44c5-a408-6e9039583378 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:02.830683 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d120072-e536-428c-9013-c2f8ecacc31c] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 37124. Dec 16 14:45:03.121000 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2eab65f5-5624-44c5-a408-6e9039583378 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:03.138333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2eab65f5-5624-44c5-a408-6e9039583378 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1319 microversion: 2.1 time: 0.484197 Dec 16 14:45:03.139738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 318/656] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:02 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:04.184388 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-622b5d80-74d9-4e88-b739-f502967c9db4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:04.186746 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-622b5d80-74d9-4e88-b739-f502967c9db4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:04.203341 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-622b5d80-74d9-4e88-b739-f502967c9db4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:04.204591 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-622b5d80-74d9-4e88-b739-f502967c9db4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:04.206376 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-622b5d80-74d9-4e88-b739-f502967c9db4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:04.207749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-622b5d80-74d9-4e88-b739-f502967c9db4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:04.641940 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-622b5d80-74d9-4e88-b739-f502967c9db4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:04.668020 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-622b5d80-74d9-4e88-b739-f502967c9db4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1319 microversion: 2.1 time: 0.503007 Dec 16 14:45:04.669436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 339/657] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:04 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:04.761503 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-f5bb34ad-a735-4971-acbf-7d150be37691 req-108a339a-1db6-4fcc-bb00-61c23ab86eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1747dc01-042a-43ca-af34-0f592eb34e76", "name": "network-vif-plugged", "status": "completed", "tag": "61d17c21-dd75-4cdb-8c24-c439e4185bf1"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:04.769678 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:04.769678 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:45:04.782588 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-f5bb34ad-a735-4971-acbf-7d150be37691 req-108a339a-1db6-4fcc-bb00-61c23ab86eab service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:04.783018 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-f5bb34ad-a735-4971-acbf-7d150be37691 req-108a339a-1db6-4fcc-bb00-61c23ab86eab service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:04.803856 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-f5bb34ad-a735-4971-acbf-7d150be37691 req-108a339a-1db6-4fcc-bb00-61c23ab86eab service nova] Creating event network-vif-plugged:61d17c21-dd75-4cdb-8c24-c439e4185bf1 for instance 1747dc01-042a-43ca-af34-0f592eb34e76 on hv-cinder-82189 Dec 16 14:45:04.811362 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-f5bb34ad-a735-4971-acbf-7d150be37691 req-108a339a-1db6-4fcc-bb00-61c23ab86eab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.439083 Dec 16 14:45:04.812360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 319/658] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:05.710024 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ab6e6c02-3d2b-404b-a234-bd40778a67ff tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:05.713782 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ab6e6c02-3d2b-404b-a234-bd40778a67ff tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:05.728259 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ab6e6c02-3d2b-404b-a234-bd40778a67ff tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:05.729797 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ab6e6c02-3d2b-404b-a234-bd40778a67ff tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:05.732214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ab6e6c02-3d2b-404b-a234-bd40778a67ff tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:05.733246 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ab6e6c02-3d2b-404b-a234-bd40778a67ff tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:06.241627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ab6e6c02-3d2b-404b-a234-bd40778a67ff tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:06.258827 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ab6e6c02-3d2b-404b-a234-bd40778a67ff tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1319 microversion: 2.1 time: 0.574620 Dec 16 14:45:06.270982 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 340/659] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:05 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1319 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:07.297693 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4318a55d-5c12-4d69-825c-62dff75a8feb tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:07.298839 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4318a55d-5c12-4d69-825c-62dff75a8feb tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:07.310770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4318a55d-5c12-4d69-825c-62dff75a8feb tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.311645 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4318a55d-5c12-4d69-825c-62dff75a8feb tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.312878 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4318a55d-5c12-4d69-825c-62dff75a8feb tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.313520 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4318a55d-5c12-4d69-825c-62dff75a8feb tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.582038 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-79e0fb2e-b1f0-4219-96dd-0e904cc48405 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Action: 'create', calling method: .version_select at 0x7f26fe645430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-17377784"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:07.619862 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-79e0fb2e-b1f0-4219-96dd-0e904cc48405 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Getting quotas for project 7210fc0bdd80446484aaf7f436c2317b. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:45:07.625736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-79e0fb2e-b1f0-4219-96dd-0e904cc48405 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Getting quotas for user a81a0ea6ec044d0a8f5f2ba192414a36 and project 7210fc0bdd80446484aaf7f436c2317b. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:45:07.694358 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4318a55d-5c12-4d69-825c-62dff75a8feb tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:07.711406 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4318a55d-5c12-4d69-825c-62dff75a8feb tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1507 microversion: 2.1 time: 0.428439 Dec 16 14:45:07.712457 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 320/660] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:07 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:07.753475 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3e0a6a12-fd22-4791-a89a-e20e583e281b tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44fe3856-ee71-4c31-b13a-5b92e2c02d45", "device": "/dev/sdb"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:07.755666 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-79e0fb2e-b1f0-4219-96dd-0e904cc48405 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Getting quotas for project 7210fc0bdd80446484aaf7f436c2317b. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:45:07.756415 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3e0a6a12-fd22-4791-a89a-e20e583e281b tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:07.761683 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-79e0fb2e-b1f0-4219-96dd-0e904cc48405 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Getting quotas for user a81a0ea6ec044d0a8f5f2ba192414a36 and project 7210fc0bdd80446484aaf7f436c2317b. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:45:07.770242 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3e0a6a12-fd22-4791-a89a-e20e583e281b tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.771012 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3e0a6a12-fd22-4791-a89a-e20e583e281b tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.772324 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3e0a6a12-fd22-4791-a89a-e20e583e281b tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.773046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3e0a6a12-fd22-4791-a89a-e20e583e281b tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.787115 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-79e0fb2e-b1f0-4219-96dd-0e904cc48405 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.214747 Dec 16 14:45:07.788229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 341/661] 10.222.0.67 () {60 vars in 1157 bytes} [Thu Dec 16 14:45:07 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:07.849718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-318629814", "imageRef": "089bdd74-7c68-48e4-9325-19e496e4a641", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-17377784", "networks": [{"uuid": "09012bc1-694e-42de-9975-bdb8824a6f4c"}]}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:07.936321 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.network.neutron [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] validate_networks() for [('09012bc1-694e-42de-9975-bdb8824a6f4c', None, None, None)] {{(pid=96670) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:45:08.405939 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3e0a6a12-fd22-4791-a89a-e20e583e281b tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "POST /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671939 Dec 16 14:45:08.407316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 321/662] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:45:07 2021] POST /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:45:08.906480 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Flavor limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:45:08.907308 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Image limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:45:08.908222 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Flavor pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:45:08.909043 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Image pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:45:08.909826 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:45:08.929249 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:08.930196 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:08.931863 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:08.932600 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:08.955894 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Getting quotas for project 7210fc0bdd80446484aaf7f436c2317b. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:45:08.960927 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Getting quotas for user a81a0ea6ec044d0a8f5f2ba192414a36 and project 7210fc0bdd80446484aaf7f436c2317b. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:45:08.974274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Going to run 1 instances... {{(pid=96670) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:45:08.976728 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='089bdd74-7c68-48e4-9325-19e496e4a641',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:45:09.036036 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-86ff4828-e652-4ace-82f2-8726f46b78e7 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.195874 Dec 16 14:45:09.048891 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 342/663] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:45:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 14:45:09.068015 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2e216788-3ac7-4b1e-8204-4a13dd66450c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:09.068732 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2e216788-3ac7-4b1e-8204-4a13dd66450c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:09.255896 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2e216788-3ac7-4b1e-8204-4a13dd66450c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:09.271802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2e216788-3ac7-4b1e-8204-4a13dd66450c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1256 microversion: 2.1 time: 0.216408 Dec 16 14:45:09.273188 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 322/664] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:09 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1256 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:10.312808 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e4eb7233-e16a-4af8-abeb-d9564aaea291 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:10.314021 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e4eb7233-e16a-4af8-abeb-d9564aaea291 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:10.328512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4eb7233-e16a-4af8-abeb-d9564aaea291 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:10.329295 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4eb7233-e16a-4af8-abeb-d9564aaea291 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:10.330723 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4eb7233-e16a-4af8-abeb-d9564aaea291 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:10.331453 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4eb7233-e16a-4af8-abeb-d9564aaea291 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:10.552022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e4eb7233-e16a-4af8-abeb-d9564aaea291 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:10.569136 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e4eb7233-e16a-4af8-abeb-d9564aaea291 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1308 microversion: 2.1 time: 0.275786 Dec 16 14:45:10.569983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 343/665] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:10 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:11.626524 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ad0527b3-c4ff-4147-bc73-3d0d7c5664b1 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:11.627791 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ad0527b3-c4ff-4147-bc73-3d0d7c5664b1 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:11.655569 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ad0527b3-c4ff-4147-bc73-3d0d7c5664b1 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:11.655993 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ad0527b3-c4ff-4147-bc73-3d0d7c5664b1 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:11.657099 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ad0527b3-c4ff-4147-bc73-3d0d7c5664b1 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:11.657725 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ad0527b3-c4ff-4147-bc73-3d0d7c5664b1 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:11.895321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ad0527b3-c4ff-4147-bc73-3d0d7c5664b1 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:11.910909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ad0527b3-c4ff-4147-bc73-3d0d7c5664b1 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1314 microversion: 2.1 time: 0.318465 Dec 16 14:45:11.912123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 323/666] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:11 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:12.944213 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-35c56f57-fd57-47af-9df8-c0ed816b16ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:12.945133 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-35c56f57-fd57-47af-9df8-c0ed816b16ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:12.953669 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-35c56f57-fd57-47af-9df8-c0ed816b16ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:12.954161 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-35c56f57-fd57-47af-9df8-c0ed816b16ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:12.954972 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-35c56f57-fd57-47af-9df8-c0ed816b16ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:12.955510 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-35c56f57-fd57-47af-9df8-c0ed816b16ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:13.410696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-35c56f57-fd57-47af-9df8-c0ed816b16ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:13.428421 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-35c56f57-fd57-47af-9df8-c0ed816b16ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.494628 Dec 16 14:45:13.429100 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 344/667] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:12 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:14.461055 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1eaa1ae1-d0aa-479b-990b-5d84da466e9a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:14.461734 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1eaa1ae1-d0aa-479b-990b-5d84da466e9a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:14.471386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1eaa1ae1-d0aa-479b-990b-5d84da466e9a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:14.471803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1eaa1ae1-d0aa-479b-990b-5d84da466e9a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:14.472633 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1eaa1ae1-d0aa-479b-990b-5d84da466e9a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:14.473037 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1eaa1ae1-d0aa-479b-990b-5d84da466e9a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:14.779938 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1eaa1ae1-d0aa-479b-990b-5d84da466e9a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:14.795979 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1eaa1ae1-d0aa-479b-990b-5d84da466e9a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.344371 Dec 16 14:45:14.797302 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 324/668] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:14 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:15.220937 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4dfbf18c-e70c-4cfe-ad62-aff1f942d7c6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:15.221955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4dfbf18c-e70c-4cfe-ad62-aff1f942d7c6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:15.240165 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dfbf18c-e70c-4cfe-ad62-aff1f942d7c6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:15.241694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dfbf18c-e70c-4cfe-ad62-aff1f942d7c6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:15.243964 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dfbf18c-e70c-4cfe-ad62-aff1f942d7c6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:15.245218 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dfbf18c-e70c-4cfe-ad62-aff1f942d7c6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:15.370665 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4dfbf18c-e70c-4cfe-ad62-aff1f942d7c6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments/efe970c2-bc00-4a68-8b8b-ee71c566e919" status: 200 len: 194 microversion: 2.20 time: 0.169963 Dec 16 14:45:15.371716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 345/669] 10.222.0.67 () {60 vars in 1453 bytes} [Thu Dec 16 14:45:15 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments/efe970c2-bc00-4a68-8b8b-ee71c566e919 => generated 194 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:15.614999 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6d374ae8-dd70-42f8-a306-93324d6d0449 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:15.616013 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6d374ae8-dd70-42f8-a306-93324d6d0449 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:15.625290 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6d374ae8-dd70-42f8-a306-93324d6d0449 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:15.625932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6d374ae8-dd70-42f8-a306-93324d6d0449 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:15.627031 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6d374ae8-dd70-42f8-a306-93324d6d0449 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:15.628343 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6d374ae8-dd70-42f8-a306-93324d6d0449 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:15.839366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-025c8c0c-0428-4213-9abc-2dead19cb851 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:15.840686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-025c8c0c-0428-4213-9abc-2dead19cb851 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:15.855426 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-025c8c0c-0428-4213-9abc-2dead19cb851 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:15.855625 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-025c8c0c-0428-4213-9abc-2dead19cb851 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:15.856915 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-025c8c0c-0428-4213-9abc-2dead19cb851 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:15.857620 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-025c8c0c-0428-4213-9abc-2dead19cb851 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:16.074230 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6d374ae8-dd70-42f8-a306-93324d6d0449 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments/efe970c2-bc00-4a68-8b8b-ee71c566e919" status: 202 len: 0 microversion: 2.20 time: 0.484046 Dec 16 14:45:16.075845 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 325/670] 10.222.0.67 () {60 vars in 1456 bytes} [Thu Dec 16 14:45:15 2021] DELETE /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments/efe970c2-bc00-4a68-8b8b-ee71c566e919 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:45:16.094196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c56d288f-2b0f-4735-8d81-39f12b2bfc42 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:16.095807 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c56d288f-2b0f-4735-8d81-39f12b2bfc42 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:16.106895 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c56d288f-2b0f-4735-8d81-39f12b2bfc42 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:16.107422 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c56d288f-2b0f-4735-8d81-39f12b2bfc42 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:16.108266 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c56d288f-2b0f-4735-8d81-39f12b2bfc42 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:16.108716 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c56d288f-2b0f-4735-8d81-39f12b2bfc42 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:16.192937 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c56d288f-2b0f-4735-8d81-39f12b2bfc42 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.110875 Dec 16 14:45:16.198030 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 326/671] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:16 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:16.277153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-025c8c0c-0428-4213-9abc-2dead19cb851 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:16.296051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-025c8c0c-0428-4213-9abc-2dead19cb851 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.480902 Dec 16 14:45:16.296956 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 346/672] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:15 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:17.211169 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-74ae0c16-2af6-4dd5-ab8f-6d8298db1715 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:17.212220 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-74ae0c16-2af6-4dd5-ab8f-6d8298db1715 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:17.221459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-74ae0c16-2af6-4dd5-ab8f-6d8298db1715 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:17.221930 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-74ae0c16-2af6-4dd5-ab8f-6d8298db1715 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:17.222744 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-74ae0c16-2af6-4dd5-ab8f-6d8298db1715 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:17.223437 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-74ae0c16-2af6-4dd5-ab8f-6d8298db1715 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:17.306815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-74ae0c16-2af6-4dd5-ab8f-6d8298db1715 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105047 Dec 16 14:45:17.307863 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 327/673] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:17 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:17.323049 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-050fcdc4-6ac7-47c0-be33-de14794fd8f2 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:17.323722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-050fcdc4-6ac7-47c0-be33-de14794fd8f2 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:17.331981 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-050fcdc4-6ac7-47c0-be33-de14794fd8f2 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:17.332420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-050fcdc4-6ac7-47c0-be33-de14794fd8f2 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:17.333218 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-050fcdc4-6ac7-47c0-be33-de14794fd8f2 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:17.333641 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-050fcdc4-6ac7-47c0-be33-de14794fd8f2 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:17.621692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-050fcdc4-6ac7-47c0-be33-de14794fd8f2 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:17.632211 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-050fcdc4-6ac7-47c0-be33-de14794fd8f2 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.321046 Dec 16 14:45:17.633096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 347/674] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:17 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:18.338777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8197abce-b465-4594-a489-f9270775dda9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:18.339735 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8197abce-b465-4594-a489-f9270775dda9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:18.348391 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8197abce-b465-4594-a489-f9270775dda9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:18.348962 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8197abce-b465-4594-a489-f9270775dda9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:18.349897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8197abce-b465-4594-a489-f9270775dda9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:18.350282 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8197abce-b465-4594-a489-f9270775dda9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:18.450935 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8197abce-b465-4594-a489-f9270775dda9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129875 Dec 16 14:45:18.451523 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 328/675] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:18 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:18.667151 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-beef28ad-123b-4e5e-a0be-817a2056b75a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:18.667955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-beef28ad-123b-4e5e-a0be-817a2056b75a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:18.677238 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-beef28ad-123b-4e5e-a0be-817a2056b75a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:18.677742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-beef28ad-123b-4e5e-a0be-817a2056b75a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:18.678546 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-beef28ad-123b-4e5e-a0be-817a2056b75a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:18.678975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-beef28ad-123b-4e5e-a0be-817a2056b75a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:18.997773 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-beef28ad-123b-4e5e-a0be-817a2056b75a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:19.030721 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-beef28ad-123b-4e5e-a0be-817a2056b75a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.374508 Dec 16 14:45:19.037738 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 348/676] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:18 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:19.471174 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6a2bbd61-ecbc-44f0-8044-cf7550503a95 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:19.472867 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6a2bbd61-ecbc-44f0-8044-cf7550503a95 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:19.484650 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6a2bbd61-ecbc-44f0-8044-cf7550503a95 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:19.485109 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6a2bbd61-ecbc-44f0-8044-cf7550503a95 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:19.486038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6a2bbd61-ecbc-44f0-8044-cf7550503a95 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:19.486475 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6a2bbd61-ecbc-44f0-8044-cf7550503a95 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:19.572069 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6a2bbd61-ecbc-44f0-8044-cf7550503a95 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111641 Dec 16 14:45:19.573137 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 329/677] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:19 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:45:20.071189 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6556d29c-6f2a-4e88-8675-ea9f446b7967 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:20.072429 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6556d29c-6f2a-4e88-8675-ea9f446b7967 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:20.090365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6556d29c-6f2a-4e88-8675-ea9f446b7967 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:20.091197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6556d29c-6f2a-4e88-8675-ea9f446b7967 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:20.092684 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6556d29c-6f2a-4e88-8675-ea9f446b7967 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:20.093748 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6556d29c-6f2a-4e88-8675-ea9f446b7967 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:20.459467 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6556d29c-6f2a-4e88-8675-ea9f446b7967 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:20.469099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6556d29c-6f2a-4e88-8675-ea9f446b7967 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.415691 Dec 16 14:45:20.469767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 349/678] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:20 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:20.594470 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a8042fd4-5581-43fc-a3b2-90489dba41f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:20.595848 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a8042fd4-5581-43fc-a3b2-90489dba41f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:20.605448 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a8042fd4-5581-43fc-a3b2-90489dba41f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:20.606007 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a8042fd4-5581-43fc-a3b2-90489dba41f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:20.607154 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a8042fd4-5581-43fc-a3b2-90489dba41f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:20.607682 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a8042fd4-5581-43fc-a3b2-90489dba41f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:20.703222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a8042fd4-5581-43fc-a3b2-90489dba41f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119576 Dec 16 14:45:20.703827 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 330/679] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:20 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:21.296930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f43cdf71-06bf-42a9-9421-984abbcc6a5a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:21.298656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f43cdf71-06bf-42a9-9421-984abbcc6a5a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:21.315327 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f43cdf71-06bf-42a9-9421-984abbcc6a5a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:21.316250 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f43cdf71-06bf-42a9-9421-984abbcc6a5a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:21.317623 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f43cdf71-06bf-42a9-9421-984abbcc6a5a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:21.318410 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f43cdf71-06bf-42a9-9421-984abbcc6a5a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:21.461965 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f43cdf71-06bf-42a9-9421-984abbcc6a5a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.183444 Dec 16 14:45:21.463756 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 350/680] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:45:21 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:45:21.522399 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-df61d8d8-050d-43c0-b6fa-252d0a1414d6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:21.523864 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-df61d8d8-050d-43c0-b6fa-252d0a1414d6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:21.546635 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-df61d8d8-050d-43c0-b6fa-252d0a1414d6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:21.547457 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-df61d8d8-050d-43c0-b6fa-252d0a1414d6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:21.549129 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-df61d8d8-050d-43c0-b6fa-252d0a1414d6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:21.550184 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-df61d8d8-050d-43c0-b6fa-252d0a1414d6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:21.666592 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2517164a-8468-4fb0-9266-785033b217aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:21.667233 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2517164a-8468-4fb0-9266-785033b217aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:21.676488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2517164a-8468-4fb0-9266-785033b217aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:21.677006 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2517164a-8468-4fb0-9266-785033b217aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:21.677891 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2517164a-8468-4fb0-9266-785033b217aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:21.678451 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2517164a-8468-4fb0-9266-785033b217aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:21.764989 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2517164a-8468-4fb0-9266-785033b217aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Going to try to terminate instance {{(pid=96670) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:45:21.971102 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2517164a-8468-4fb0-9266-785033b217aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 204 len: 0 microversion: 2.1 time: 0.310028 Dec 16 14:45:21.971102 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 351/681] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:45:21 2021] DELETE /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:45:21.989639 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b360d585-086d-427b-9657-e6664186a8a1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:21.991734 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b360d585-086d-427b-9657-e6664186a8a1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:22.002206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-df61d8d8-050d-43c0-b6fa-252d0a1414d6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:22.006563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b360d585-086d-427b-9657-e6664186a8a1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:22.007379 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b360d585-086d-427b-9657-e6664186a8a1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:22.008779 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b360d585-086d-427b-9657-e6664186a8a1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:22.009611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b360d585-086d-427b-9657-e6664186a8a1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:22.021830 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-df61d8d8-050d-43c0-b6fa-252d0a1414d6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.537333 Dec 16 14:45:22.023195 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 331/682] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:21 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:22.036840 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-988614c8-3ae1-40a2-99ea-fbbb6b0341c8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:22.043711 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-988614c8-3ae1-40a2-99ea-fbbb6b0341c8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:22.061349 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-988614c8-3ae1-40a2-99ea-fbbb6b0341c8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:22.062192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-988614c8-3ae1-40a2-99ea-fbbb6b0341c8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:22.063506 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-988614c8-3ae1-40a2-99ea-fbbb6b0341c8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:22.064234 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-988614c8-3ae1-40a2-99ea-fbbb6b0341c8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:22.154848 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b360d585-086d-427b-9657-e6664186a8a1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.185014 Dec 16 14:45:22.156472 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 352/683] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:21 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:22.452962 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-988614c8-3ae1-40a2-99ea-fbbb6b0341c8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:22.468471 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-988614c8-3ae1-40a2-99ea-fbbb6b0341c8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1674 microversion: 2.1 time: 0.443731 Dec 16 14:45:22.469329 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 332/684] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:22 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1674 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:23.053508 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c3b725ab-e236-4585-8fb5-df191a4a969a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:23.054252 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c3b725ab-e236-4585-8fb5-df191a4a969a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:23.062486 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c3b725ab-e236-4585-8fb5-df191a4a969a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:23.062939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c3b725ab-e236-4585-8fb5-df191a4a969a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:23.063741 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c3b725ab-e236-4585-8fb5-df191a4a969a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:23.064175 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c3b725ab-e236-4585-8fb5-df191a4a969a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:23.188770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b12f1a49-609c-4427-8920-6f243d2c4f01 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:23.190746 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b12f1a49-609c-4427-8920-6f243d2c4f01 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:23.202830 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b12f1a49-609c-4427-8920-6f243d2c4f01 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:23.203289 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b12f1a49-609c-4427-8920-6f243d2c4f01 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:23.204088 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b12f1a49-609c-4427-8920-6f243d2c4f01 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:23.204521 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b12f1a49-609c-4427-8920-6f243d2c4f01 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:23.323069 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b12f1a49-609c-4427-8920-6f243d2c4f01 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.156359 Dec 16 14:45:23.324341 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 333/685] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:23 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:45:23.350292 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c3b725ab-e236-4585-8fb5-df191a4a969a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:23.359704 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c3b725ab-e236-4585-8fb5-df191a4a969a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.315694 Dec 16 14:45:23.360287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 353/686] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:23 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:23.501407 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-bde38fdb-abbe-451e-8efd-6b4dca0eb2e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:23.502450 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-bde38fdb-abbe-451e-8efd-6b4dca0eb2e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:23.517608 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bde38fdb-abbe-451e-8efd-6b4dca0eb2e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:23.518596 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bde38fdb-abbe-451e-8efd-6b4dca0eb2e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:23.520049 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bde38fdb-abbe-451e-8efd-6b4dca0eb2e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:23.520783 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bde38fdb-abbe-451e-8efd-6b4dca0eb2e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:23.799724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bde38fdb-abbe-451e-8efd-6b4dca0eb2e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:23.818631 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-bde38fdb-abbe-451e-8efd-6b4dca0eb2e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1674 microversion: 2.1 time: 0.333276 Dec 16 14:45:23.819386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 334/687] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:23 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1674 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:24.346452 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6a3933d6-4456-478e-87b8-c26faedb33d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:24.347489 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6a3933d6-4456-478e-87b8-c26faedb33d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:24.358168 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a3933d6-4456-478e-87b8-c26faedb33d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.358936 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a3933d6-4456-478e-87b8-c26faedb33d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:24.360299 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a3933d6-4456-478e-87b8-c26faedb33d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.361203 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a3933d6-4456-478e-87b8-c26faedb33d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:24.385929 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5c86d0c2-d7ff-4c48-9084-9f1a80a11346 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:24.386916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5c86d0c2-d7ff-4c48-9084-9f1a80a11346 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:24.395185 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5c86d0c2-d7ff-4c48-9084-9f1a80a11346 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.395647 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5c86d0c2-d7ff-4c48-9084-9f1a80a11346 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:24.396443 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5c86d0c2-d7ff-4c48-9084-9f1a80a11346 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.397096 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5c86d0c2-d7ff-4c48-9084-9f1a80a11346 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:24.445854 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6a3933d6-4456-478e-87b8-c26faedb33d9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112062 Dec 16 14:45:24.446544 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 354/688] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:24 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:24.698445 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5c86d0c2-d7ff-4c48-9084-9f1a80a11346 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:24.707715 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5c86d0c2-d7ff-4c48-9084-9f1a80a11346 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.334310 Dec 16 14:45:24.708284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 335/689] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:24 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:24.844146 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2f086e3d-19f4-4aa2-b123-507b6e827601 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:24.844753 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2f086e3d-19f4-4aa2-b123-507b6e827601 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:24.854071 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f086e3d-19f4-4aa2-b123-507b6e827601 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.854690 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f086e3d-19f4-4aa2-b123-507b6e827601 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:24.855700 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f086e3d-19f4-4aa2-b123-507b6e827601 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.856230 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f086e3d-19f4-4aa2-b123-507b6e827601 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:25.121119 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2f086e3d-19f4-4aa2-b123-507b6e827601 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:25.137905 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2f086e3d-19f4-4aa2-b123-507b6e827601 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1674 microversion: 2.1 time: 0.303945 Dec 16 14:45:25.138921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 355/690] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:24 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1674 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:25.467718 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ef182431-b1a7-4d3a-b40c-e8620b23f5d4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:25.469065 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ef182431-b1a7-4d3a-b40c-e8620b23f5d4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:25.480034 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef182431-b1a7-4d3a-b40c-e8620b23f5d4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:25.480685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef182431-b1a7-4d3a-b40c-e8620b23f5d4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:25.481649 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef182431-b1a7-4d3a-b40c-e8620b23f5d4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:25.482245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef182431-b1a7-4d3a-b40c-e8620b23f5d4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:25.563960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ef182431-b1a7-4d3a-b40c-e8620b23f5d4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107780 Dec 16 14:45:25.564882 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 336/691] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:25 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:25.736845 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-83cd447a-f6d3-465d-9dd8-5a82cff50826 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:25.737656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-83cd447a-f6d3-465d-9dd8-5a82cff50826 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:25.746579 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83cd447a-f6d3-465d-9dd8-5a82cff50826 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:25.747086 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83cd447a-f6d3-465d-9dd8-5a82cff50826 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:25.747914 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83cd447a-f6d3-465d-9dd8-5a82cff50826 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:25.748372 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83cd447a-f6d3-465d-9dd8-5a82cff50826 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:25.988809 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-83cd447a-f6d3-465d-9dd8-5a82cff50826 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:26.004355 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-83cd447a-f6d3-465d-9dd8-5a82cff50826 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.277506 Dec 16 14:45:26.005278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 356/692] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:25 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:26.170479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cd3f0202-9962-48bf-810a-adf299915332 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:26.171106 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cd3f0202-9962-48bf-810a-adf299915332 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:26.179156 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd3f0202-9962-48bf-810a-adf299915332 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:26.179603 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd3f0202-9962-48bf-810a-adf299915332 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:26.180391 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd3f0202-9962-48bf-810a-adf299915332 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:26.180815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd3f0202-9962-48bf-810a-adf299915332 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:26.435465 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cd3f0202-9962-48bf-810a-adf299915332 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:26.445249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cd3f0202-9962-48bf-810a-adf299915332 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1674 microversion: 2.1 time: 0.284374 Dec 16 14:45:26.445823 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 337/693] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:26 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1674 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:26.582137 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4463d932-8f0a-47bc-8d17-cb5999723d53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:26.583115 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4463d932-8f0a-47bc-8d17-cb5999723d53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:26.591354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4463d932-8f0a-47bc-8d17-cb5999723d53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:26.591792 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4463d932-8f0a-47bc-8d17-cb5999723d53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:26.592584 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4463d932-8f0a-47bc-8d17-cb5999723d53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:26.593015 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4463d932-8f0a-47bc-8d17-cb5999723d53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:26.676694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4463d932-8f0a-47bc-8d17-cb5999723d53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104277 Dec 16 14:45:26.677297 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 357/694] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:26 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:27.035124 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-15476570-f8c3-47c2-a31a-d27395dff30f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:27.037134 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-15476570-f8c3-47c2-a31a-d27395dff30f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:27.049205 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-15476570-f8c3-47c2-a31a-d27395dff30f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:27.050040 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-15476570-f8c3-47c2-a31a-d27395dff30f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:27.051425 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-15476570-f8c3-47c2-a31a-d27395dff30f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:27.052073 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-15476570-f8c3-47c2-a31a-d27395dff30f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:27.365589 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-15476570-f8c3-47c2-a31a-d27395dff30f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:27.375452 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-15476570-f8c3-47c2-a31a-d27395dff30f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.352285 Dec 16 14:45:27.376016 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 338/695] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:27 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:27.473064 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-34a41caa-a74b-49cc-97c9-b41e1c47d5fa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:27.473733 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-34a41caa-a74b-49cc-97c9-b41e1c47d5fa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:27.485304 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34a41caa-a74b-49cc-97c9-b41e1c47d5fa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:27.486080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34a41caa-a74b-49cc-97c9-b41e1c47d5fa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:27.487475 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34a41caa-a74b-49cc-97c9-b41e1c47d5fa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:27.488230 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34a41caa-a74b-49cc-97c9-b41e1c47d5fa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:27.708514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-877617e5-c9f5-496e-8c5c-70047fc6e34f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:27.711582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-877617e5-c9f5-496e-8c5c-70047fc6e34f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:27.730124 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-877617e5-c9f5-496e-8c5c-70047fc6e34f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:27.730916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-877617e5-c9f5-496e-8c5c-70047fc6e34f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:27.732332 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-877617e5-c9f5-496e-8c5c-70047fc6e34f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:27.733081 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-877617e5-c9f5-496e-8c5c-70047fc6e34f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:27.855170 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-877617e5-c9f5-496e-8c5c-70047fc6e34f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165733 Dec 16 14:45:27.855170 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 339/696] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:27 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:28.119399 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-34a41caa-a74b-49cc-97c9-b41e1c47d5fa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:28.135986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-34a41caa-a74b-49cc-97c9-b41e1c47d5fa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1674 microversion: 2.1 time: 0.675581 Dec 16 14:45:28.136675 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 358/697] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:27 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1674 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:28.408233 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7e3c01af-3563-4e4f-8752-96a1942a0917 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:28.409218 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7e3c01af-3563-4e4f-8752-96a1942a0917 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:28.419587 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7e3c01af-3563-4e4f-8752-96a1942a0917 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:28.420395 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7e3c01af-3563-4e4f-8752-96a1942a0917 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:28.421205 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7e3c01af-3563-4e4f-8752-96a1942a0917 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:28.421736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7e3c01af-3563-4e4f-8752-96a1942a0917 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:28.560392 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-2353e650-777e-4c13-b3e0-bbc0d5c7fedf req-55c5bf6b-d09e-45c6-8109-5415c1186968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f3f655-81f2-49a1-8ae3-1961c329487b", "tag": "a286353e-4b59-4c95-8963-0d90f65f6f8b"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:28.567833 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:28.567833 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:45:28.581622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-2353e650-777e-4c13-b3e0-bbc0d5c7fedf req-55c5bf6b-d09e-45c6-8109-5415c1186968 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:28.582224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-2353e650-777e-4c13-b3e0-bbc0d5c7fedf req-55c5bf6b-d09e-45c6-8109-5415c1186968 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:28.604087 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-2353e650-777e-4c13-b3e0-bbc0d5c7fedf req-55c5bf6b-d09e-45c6-8109-5415c1186968 service nova] Creating event network-changed:a286353e-4b59-4c95-8963-0d90f65f6f8b for instance 65f3f655-81f2-49a1-8ae3-1961c329487b on hv-cinder-82189 Dec 16 14:45:28.609431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-2353e650-777e-4c13-b3e0-bbc0d5c7fedf req-55c5bf6b-d09e-45c6-8109-5415c1186968 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063336 Dec 16 14:45:28.610308 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 359/698] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:45:28.707341 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7e3c01af-3563-4e4f-8752-96a1942a0917 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:28.716852 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7e3c01af-3563-4e4f-8752-96a1942a0917 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.320697 Dec 16 14:45:28.717422 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 340/699] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:28 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:28.876108 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9ee6a8a4-38a9-41d2-a692-1f44d9a3f08c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:28.877131 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9ee6a8a4-38a9-41d2-a692-1f44d9a3f08c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:28.885598 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ee6a8a4-38a9-41d2-a692-1f44d9a3f08c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:28.886072 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ee6a8a4-38a9-41d2-a692-1f44d9a3f08c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:28.886860 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ee6a8a4-38a9-41d2-a692-1f44d9a3f08c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:28.887285 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ee6a8a4-38a9-41d2-a692-1f44d9a3f08c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:28.963466 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9ee6a8a4-38a9-41d2-a692-1f44d9a3f08c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098002 Dec 16 14:45:28.964145 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 360/700] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:28 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:45:29.162050 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-78b6ebe4-fc18-43aa-a4ae-9dab67a694e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:29.162827 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-78b6ebe4-fc18-43aa-a4ae-9dab67a694e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:29.172371 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-78b6ebe4-fc18-43aa-a4ae-9dab67a694e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:29.173119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-78b6ebe4-fc18-43aa-a4ae-9dab67a694e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:29.174219 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-78b6ebe4-fc18-43aa-a4ae-9dab67a694e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:29.174924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-78b6ebe4-fc18-43aa-a4ae-9dab67a694e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:29.747596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e24e9db6-57eb-4c73-8e58-206c299a7151 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:29.750574 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e24e9db6-57eb-4c73-8e58-206c299a7151 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:29.773263 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e24e9db6-57eb-4c73-8e58-206c299a7151 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:29.774117 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e24e9db6-57eb-4c73-8e58-206c299a7151 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:29.783969 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e24e9db6-57eb-4c73-8e58-206c299a7151 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:29.788916 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e24e9db6-57eb-4c73-8e58-206c299a7151 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:29.982451 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-78b6ebe4-fc18-43aa-a4ae-9dab67a694e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:29.999552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-78b6ebe4-fc18-43aa-a4ae-9dab67a694e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1674 microversion: 2.1 time: 0.848478 Dec 16 14:45:30.001116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 341/701] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:29 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1674 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:30.012653 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-bb827dc2-9e60-46c8-a372-1a088692c5c5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:30.013921 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-bb827dc2-9e60-46c8-a372-1a088692c5c5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:30.022572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bb827dc2-9e60-46c8-a372-1a088692c5c5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:30.023239 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bb827dc2-9e60-46c8-a372-1a088692c5c5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:30.024405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bb827dc2-9e60-46c8-a372-1a088692c5c5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:30.025002 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bb827dc2-9e60-46c8-a372-1a088692c5c5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:30.173681 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-bb827dc2-9e60-46c8-a372-1a088692c5c5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.170837 Dec 16 14:45:30.181617 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 342/702] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:45:30 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:30.335090 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-eadf270a-4a86-41c7-ab38-302103955d80 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:30.335899 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-eadf270a-4a86-41c7-ab38-302103955d80 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:30.346748 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eadf270a-4a86-41c7-ab38-302103955d80 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:30.347792 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eadf270a-4a86-41c7-ab38-302103955d80 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:30.348508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eadf270a-4a86-41c7-ab38-302103955d80 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:30.348939 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eadf270a-4a86-41c7-ab38-302103955d80 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:30.425654 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-eadf270a-4a86-41c7-ab38-302103955d80 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:45:30.431517 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e24e9db6-57eb-4c73-8e58-206c299a7151 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:30.441036 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e24e9db6-57eb-4c73-8e58-206c299a7151 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.710219 Dec 16 14:45:30.442070 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 361/703] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:29 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:30.727421 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-eadf270a-4a86-41c7-ab38-302103955d80 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 204 len: 0 microversion: 2.20 time: 0.406013 Dec 16 14:45:30.728085 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 343/704] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Dec 16 14:45:30 2021] DELETE /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:45:30.742908 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:30.743614 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:30.752639 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:30.753844 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:30.754951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:30.755852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:31.012510 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:31.044664 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b936b781-e4e8-4987-a248-28a85cc36303 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:31.047165 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b936b781-e4e8-4987-a248-28a85cc36303 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:31.048112 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:31.060601 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:31.061542 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b936b781-e4e8-4987-a248-28a85cc36303 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:31.062160 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5a731dc3-7369-4257-bf44-25905599355f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.328529 Dec 16 14:45:31.062527 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b936b781-e4e8-4987-a248-28a85cc36303 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:31.063806 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b936b781-e4e8-4987-a248-28a85cc36303 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:31.064458 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 362/705] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:30 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:31.065224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b936b781-e4e8-4987-a248-28a85cc36303 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:31.369064 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b936b781-e4e8-4987-a248-28a85cc36303 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:31.378762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b936b781-e4e8-4987-a248-28a85cc36303 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1606 microversion: 2.1 time: 0.350940 Dec 16 14:45:31.389917 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 344/706] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:31 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1606 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:31.477040 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4d3a7019-4a8f-455a-924e-9e24bc8146c0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:31.477683 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4d3a7019-4a8f-455a-924e-9e24bc8146c0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:31.486656 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4d3a7019-4a8f-455a-924e-9e24bc8146c0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:31.487096 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4d3a7019-4a8f-455a-924e-9e24bc8146c0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:31.487894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4d3a7019-4a8f-455a-924e-9e24bc8146c0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:31.488323 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4d3a7019-4a8f-455a-924e-9e24bc8146c0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:31.503986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-bb91a774-fa7a-4251-b6c6-020a6aa5bc46 req-c2185549-1187-49de-b87b-7f87e1521788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d728139-ef79-4b38-b489-6fd9aa84d0fa", "name": "network-vif-deleted", "tag": "c97c5936-fff0-4630-886d-e693f3707c42"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:31.512274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:31.512274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:45:31.530582 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-bb91a774-fa7a-4251-b6c6-020a6aa5bc46 req-c2185549-1187-49de-b87b-7f87e1521788 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:31.531011 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-bb91a774-fa7a-4251-b6c6-020a6aa5bc46 req-c2185549-1187-49de-b87b-7f87e1521788 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:31.549058 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-bb91a774-fa7a-4251-b6c6-020a6aa5bc46 req-c2185549-1187-49de-b87b-7f87e1521788 service nova] Creating event network-vif-deleted:c97c5936-fff0-4630-886d-e693f3707c42 for instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa on hv-cinder-82189 Dec 16 14:45:31.554887 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-bb91a774-fa7a-4251-b6c6-020a6aa5bc46 req-c2185549-1187-49de-b87b-7f87e1521788 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180195 Dec 16 14:45:31.555856 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 363/707] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:45:31.756192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4d3a7019-4a8f-455a-924e-9e24bc8146c0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:31.766871 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4d3a7019-4a8f-455a-924e-9e24bc8146c0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.303055 Dec 16 14:45:31.768217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 345/708] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:31 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:32.089796 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:32.090540 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:32.098683 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:32.099127 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:32.099914 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:32.100355 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:32.354897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:32.370796 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:32.377778 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:32.378989 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-37c2a816-cd47-4b1a-92ed-d508c30f6fb5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.300400 Dec 16 14:45:32.379824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 364/709] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:32 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:32.407334 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4474aa8b-7b95-4d13-8b39-440d7d27de3e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:32.408257 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4474aa8b-7b95-4d13-8b39-440d7d27de3e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:32.421015 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4474aa8b-7b95-4d13-8b39-440d7d27de3e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:32.422151 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4474aa8b-7b95-4d13-8b39-440d7d27de3e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:32.423715 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4474aa8b-7b95-4d13-8b39-440d7d27de3e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:32.424660 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4474aa8b-7b95-4d13-8b39-440d7d27de3e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:32.632906 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4474aa8b-7b95-4d13-8b39-440d7d27de3e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:32.649572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4474aa8b-7b95-4d13-8b39-440d7d27de3e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1606 microversion: 2.1 time: 0.255376 Dec 16 14:45:32.650765 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 346/710] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:32 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1606 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:32.797602 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4ecc1ee4-b800-4889-ac1d-e997f7343f0e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:32.798280 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4ecc1ee4-b800-4889-ac1d-e997f7343f0e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:32.807383 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4ecc1ee4-b800-4889-ac1d-e997f7343f0e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:32.807842 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4ecc1ee4-b800-4889-ac1d-e997f7343f0e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:32.808657 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4ecc1ee4-b800-4889-ac1d-e997f7343f0e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:32.809092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4ecc1ee4-b800-4889-ac1d-e997f7343f0e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:33.092530 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4ecc1ee4-b800-4889-ac1d-e997f7343f0e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:33.112146 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4ecc1ee4-b800-4889-ac1d-e997f7343f0e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.329678 Dec 16 14:45:33.126882 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 365/711] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:32 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:33.404595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:33.405284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:33.413592 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:33.414399 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:33.414837 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:33.415446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:33.656217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:33.672817 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:33.676481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f7cc6cef-0aff-4cdd-8666-602041e15297 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:33.678322 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f7cc6cef-0aff-4cdd-8666-602041e15297 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:33.679918 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:33.681097 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-224295b1-7853-4257-a77a-73c07651774e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.287588 Dec 16 14:45:33.682015 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 347/712] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:33 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:33.688166 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7cc6cef-0aff-4cdd-8666-602041e15297 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:33.688683 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7cc6cef-0aff-4cdd-8666-602041e15297 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:33.689754 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7cc6cef-0aff-4cdd-8666-602041e15297 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:33.690299 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f7cc6cef-0aff-4cdd-8666-602041e15297 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:33.826387 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f7cc6cef-0aff-4cdd-8666-602041e15297 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:33.835320 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f7cc6cef-0aff-4cdd-8666-602041e15297 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1606 microversion: 2.1 time: 0.170409 Dec 16 14:45:33.835892 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 366/713] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:33 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1606 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:34.155741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2b11b808-70aa-4b80-84ae-dc416a95806f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:34.156864 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2b11b808-70aa-4b80-84ae-dc416a95806f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:34.172581 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2b11b808-70aa-4b80-84ae-dc416a95806f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:34.173361 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2b11b808-70aa-4b80-84ae-dc416a95806f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:34.174897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2b11b808-70aa-4b80-84ae-dc416a95806f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:34.175699 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2b11b808-70aa-4b80-84ae-dc416a95806f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:34.569176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2b11b808-70aa-4b80-84ae-dc416a95806f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:34.579487 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2b11b808-70aa-4b80-84ae-dc416a95806f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.443587 Dec 16 14:45:34.580436 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 348/714] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:34 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:34.708022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:34.708802 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:34.716836 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:34.717270 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:34.718116 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:34.718586 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:34.863444 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b1fc482f-86e3-488d-b899-bcb664a92d0e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:34.865170 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b1fc482f-86e3-488d-b899-bcb664a92d0e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:34.875017 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b1fc482f-86e3-488d-b899-bcb664a92d0e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:34.875790 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b1fc482f-86e3-488d-b899-bcb664a92d0e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:34.876970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b1fc482f-86e3-488d-b899-bcb664a92d0e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:34.878486 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b1fc482f-86e3-488d-b899-bcb664a92d0e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:35.026520 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b1fc482f-86e3-488d-b899-bcb664a92d0e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:35.034056 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:35.036808 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b1fc482f-86e3-488d-b899-bcb664a92d0e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1322 microversion: 2.1 time: 0.187275 Dec 16 14:45:35.037487 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 349/715] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:34 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:35.063464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:35.077359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:35.079486 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-54dae723-744b-4640-bf54-d48927f6b10a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.381882 Dec 16 14:45:35.080432 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 367/716] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:34 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:35.602846 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5d3dc816-c80a-4bcf-ad16-66099a102c65 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:35.603482 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5d3dc816-c80a-4bcf-ad16-66099a102c65 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:35.612601 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5d3dc816-c80a-4bcf-ad16-66099a102c65 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:35.613125 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5d3dc816-c80a-4bcf-ad16-66099a102c65 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:35.614161 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5d3dc816-c80a-4bcf-ad16-66099a102c65 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:35.614590 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5d3dc816-c80a-4bcf-ad16-66099a102c65 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:35.859915 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5d3dc816-c80a-4bcf-ad16-66099a102c65 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:35.869519 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5d3dc816-c80a-4bcf-ad16-66099a102c65 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.276561 Dec 16 14:45:35.870672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 350/717] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:35 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:36.065701 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:36.066327 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:36.074157 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:36.074607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:36.075459 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:36.075885 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:36.107570 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:36.108492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:36.119179 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:36.120403 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:36.121373 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:36.121982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:36.173436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:36.174266 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:36.175079 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lazy-loading 'fault' on Instance uuid 7d728139-ef79-4b38-b489-6fd9aa84d0fa {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:45:36.272045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:36.282731 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-749cc746-43cc-470b-8771-41b11f3fd281 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 200 len: 1327 microversion: 2.1 time: 0.226736 Dec 16 14:45:36.283902 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 368/718] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:36 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 1327 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:36.379826 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:36.404553 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:36.419981 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:36.422134 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d3ce7c17-e326-4165-889c-39a8107f8ce2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.325436 Dec 16 14:45:36.423073 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 351/719] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:36 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:36.893056 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ac73caab-9c6d-4d2c-a4bc-75cf3f37518e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:36.893567 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ac73caab-9c6d-4d2c-a4bc-75cf3f37518e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:36.902261 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ac73caab-9c6d-4d2c-a4bc-75cf3f37518e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:36.902724 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ac73caab-9c6d-4d2c-a4bc-75cf3f37518e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:36.903592 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ac73caab-9c6d-4d2c-a4bc-75cf3f37518e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:36.904015 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ac73caab-9c6d-4d2c-a4bc-75cf3f37518e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:37.187230 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ac73caab-9c6d-4d2c-a4bc-75cf3f37518e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:37.199113 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ac73caab-9c6d-4d2c-a4bc-75cf3f37518e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.314654 Dec 16 14:45:37.207462 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 369/720] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:36 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:37.306601 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-78c95cbf-ba8c-4c7a-9f56-2d7cac771fb3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:37.307353 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-78c95cbf-ba8c-4c7a-9f56-2d7cac771fb3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:37.315550 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-78c95cbf-ba8c-4c7a-9f56-2d7cac771fb3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:37.315949 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-78c95cbf-ba8c-4c7a-9f56-2d7cac771fb3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:37.316763 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-78c95cbf-ba8c-4c7a-9f56-2d7cac771fb3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:37.317198 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-78c95cbf-ba8c-4c7a-9f56-2d7cac771fb3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:37.370239 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-78c95cbf-ba8c-4c7a-9f56-2d7cac771fb3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] HTTP exception thrown: Instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa could not be found. Dec 16 14:45:37.371038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-78c95cbf-ba8c-4c7a-9f56-2d7cac771fb3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Returning 404 to user: Instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:45:37.371927 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-78c95cbf-ba8c-4c7a-9f56-2d7cac771fb3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 404 len: 111 microversion: 2.1 time: 0.075121 Dec 16 14:45:37.372490 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 352/721] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:37 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:45:37.387026 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d8c58d2a-58c1-4956-9cb6-585fbc074285 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '.version_select at 0x7f26fe6af670>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:37.418974 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d8c58d2a-58c1-4956-9cb6-585fbc074285 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036979630" status: 202 len: 0 microversion: 2.1 time: 0.040491 Dec 16 14:45:37.420009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 370/722] 10.222.0.67 () {58 vars in 1220 bytes} [Thu Dec 16 14:45:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036979630 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:45:37.458849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:37.459318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:37.468267 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:37.469057 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:37.470108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:37.470716 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:37.713395 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:37.728460 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:37.735209 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:37.736375 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-01766956-0974-4eea-8906-aaddf6cccf52 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.288203 Dec 16 14:45:37.736932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 353/723] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:37 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:38.226163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6ff27027-5233-49aa-a755-1c38fa7c4b3a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:38.227067 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6ff27027-5233-49aa-a755-1c38fa7c4b3a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:38.236527 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6ff27027-5233-49aa-a755-1c38fa7c4b3a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:38.236970 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6ff27027-5233-49aa-a755-1c38fa7c4b3a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:38.237757 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6ff27027-5233-49aa-a755-1c38fa7c4b3a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:38.238295 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6ff27027-5233-49aa-a755-1c38fa7c4b3a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:38.767600 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:38.768255 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:38.771338 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6ff27027-5233-49aa-a755-1c38fa7c4b3a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:38.778143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:38.778593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:38.779391 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:38.790015 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:38.790408 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6ff27027-5233-49aa-a755-1c38fa7c4b3a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.565152 Dec 16 14:45:38.790408 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 371/724] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:38 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:38.861011 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-221cdd2a-34f0-4d29-98d0-12eeffbeb0b5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'create', calling method: .version_select at 0x7f26fe6af670>, body: {"keypair": {"name": "tempest-keypair-70758270"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:38.895261 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-221cdd2a-34f0-4d29-98d0-12eeffbeb0b5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for project f78091827c644b1fb185ec17f9aa73e2. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:45:38.900198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-221cdd2a-34f0-4d29-98d0-12eeffbeb0b5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for user 6c6c792676f1498e98f638a268abf1e5 and project f78091827c644b1fb185ec17f9aa73e2. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:45:39.018284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:39.033484 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:39.040397 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:39.041631 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4de21f1c-368c-4b7d-a27e-08e33e6482cd tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.284359 Dec 16 14:45:39.042621 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 354/725] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:38 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:39.222270 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-221cdd2a-34f0-4d29-98d0-12eeffbeb0b5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for project f78091827c644b1fb185ec17f9aa73e2. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:45:39.226699 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-221cdd2a-34f0-4d29-98d0-12eeffbeb0b5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for user 6c6c792676f1498e98f638a268abf1e5 and project f78091827c644b1fb185ec17f9aa73e2. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:45:39.240608 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-221cdd2a-34f0-4d29-98d0-12eeffbeb0b5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.393173 Dec 16 14:45:39.241202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 372/726] 10.222.0.67 () {60 vars in 1157 bytes} [Thu Dec 16 14:45:38 2021] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:39.816455 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-224942aa-e8b8-407c-883c-21399f476c87 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:39.817627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-224942aa-e8b8-407c-883c-21399f476c87 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:39.832846 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-224942aa-e8b8-407c-883c-21399f476c87 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:39.833251 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-224942aa-e8b8-407c-883c-21399f476c87 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:39.835107 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-224942aa-e8b8-407c-883c-21399f476c87 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:39.835777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-224942aa-e8b8-407c-883c-21399f476c87 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:40.069212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:40.070333 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:40.079062 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:40.085152 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:40.087144 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:40.087737 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:40.155621 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-224942aa-e8b8-407c-883c-21399f476c87 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:40.165608 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-224942aa-e8b8-407c-883c-21399f476c87 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.369507 Dec 16 14:45:40.167657 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 355/727] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:39 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:40.536036 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:40.551557 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:40.559885 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:40.561091 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2ec5aa87-2b6d-4ee0-adcb-944c0ea92b2a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.503407 Dec 16 14:45:40.561636 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 373/728] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:40 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:41.191874 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4acd7fd1-b884-4b0a-a8b5-0f0aafdbfdf4 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:41.192603 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4acd7fd1-b884-4b0a-a8b5-0f0aafdbfdf4 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:41.200436 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4acd7fd1-b884-4b0a-a8b5-0f0aafdbfdf4 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:41.200866 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4acd7fd1-b884-4b0a-a8b5-0f0aafdbfdf4 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:41.201642 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4acd7fd1-b884-4b0a-a8b5-0f0aafdbfdf4 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:41.202084 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4acd7fd1-b884-4b0a-a8b5-0f0aafdbfdf4 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:41.463887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4acd7fd1-b884-4b0a-a8b5-0f0aafdbfdf4 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:41.472522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4acd7fd1-b884-4b0a-a8b5-0f0aafdbfdf4 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.291521 Dec 16 14:45:41.473091 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 356/729] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:41 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:41.595957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:41.597032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:41.608418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:41.608859 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:41.609624 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:41.610281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:41.624337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1610947549", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6169d189-9be4-4abd-beaa-98b69d0a6fcc"}], "security_groups": [{"name": "tempest-securitygroup--279208687"}], "key_name": "tempest-keypair-70758270", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:41.849167 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:41.867666 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:41.874309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:41.875488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0f6cc3ab-cfaa-4925-8d10-f2db6ebbcf28 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1723 microversion: 2.20 time: 0.291132 Dec 16 14:45:41.876374 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 374/730] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:41 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:41.924728 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] validate_networks() for [('6169d189-9be4-4abd-beaa-98b69d0a6fcc', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:45:42.516956 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8230821c-1956-448e-9f9d-5f5afed37152 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:42.518472 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8230821c-1956-448e-9f9d-5f5afed37152 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:42.534332 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8230821c-1956-448e-9f9d-5f5afed37152 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:42.535556 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8230821c-1956-448e-9f9d-5f5afed37152 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:42.537582 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8230821c-1956-448e-9f9d-5f5afed37152 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:42.538378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8230821c-1956-448e-9f9d-5f5afed37152 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:43.064897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8230821c-1956-448e-9f9d-5f5afed37152 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:43.076590 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8230821c-1956-448e-9f9d-5f5afed37152 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.582997 Dec 16 14:45:43.077562 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 375/731] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:42 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:43.089952 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:43.090875 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:43.099073 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:43.099515 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:43.100319 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:43.100751 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:43.391707 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:43.409632 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:43.416789 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:43.418487 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-af535da0-f80a-43b6-a93b-39e7d3b283b9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1655 microversion: 2.20 time: 0.339518 Dec 16 14:45:43.419161 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 376/732] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:43 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1655 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:43.549789 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:45:43.551922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:45:43.552928 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:45:43.553924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:45:43.554934 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:45:43.572382 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:43.573324 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:43.575896 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:43.576838 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:43.614717 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for project f78091827c644b1fb185ec17f9aa73e2. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:45:43.623579 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Getting quotas for user 6c6c792676f1498e98f638a268abf1e5 and project f78091827c644b1fb185ec17f9aa73e2. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:45:43.649387 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:45:43.652467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:45:43.707118 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-08b7e2f2-4955-428c-b501-e317f57cd2a4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.094245 Dec 16 14:45:43.714792 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 357/733] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:45:41 2021] POST /compute/v2.1/servers => generated 401 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:45:43.751242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cf3f5928-902d-493f-8445-ad8e6d5df647 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:43.752599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cf3f5928-902d-493f-8445-ad8e6d5df647 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:44.005299 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cf3f5928-902d-493f-8445-ad8e6d5df647 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:44.025358 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cf3f5928-902d-493f-8445-ad8e6d5df647 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1236 microversion: 2.1 time: 0.291492 Dec 16 14:45:44.030425 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 377/734] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:43 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1236 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:44.132116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-374278e3-7675-4fce-ade0-08c9a85ff10c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:44.133648 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-374278e3-7675-4fce-ade0-08c9a85ff10c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:44.147736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-0a3ad04c-63df-42d1-9f05-c85d10c264e0 req-99e1a5cb-2d4b-449c-8916-6fbdce287e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b5c02-69ca-4290-bba0-54d6ed2eb215", "name": "network-vif-deleted", "tag": "e59517d2-2291-4c73-889e-594d9cc076e2"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:44.149291 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-374278e3-7675-4fce-ade0-08c9a85ff10c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:44.150466 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-374278e3-7675-4fce-ade0-08c9a85ff10c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:44.152108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-374278e3-7675-4fce-ade0-08c9a85ff10c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:44.152815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-374278e3-7675-4fce-ade0-08c9a85ff10c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:44.182925 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:44.182925 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:45:44.216870 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-0a3ad04c-63df-42d1-9f05-c85d10c264e0 req-99e1a5cb-2d4b-449c-8916-6fbdce287e16 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:44.218148 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-0a3ad04c-63df-42d1-9f05-c85d10c264e0 req-99e1a5cb-2d4b-449c-8916-6fbdce287e16 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:44.269440 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-0a3ad04c-63df-42d1-9f05-c85d10c264e0 req-99e1a5cb-2d4b-449c-8916-6fbdce287e16 service nova] Creating event network-vif-deleted:e59517d2-2291-4c73-889e-594d9cc076e2 for instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 on hv-cinder-82189 Dec 16 14:45:44.287806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-0a3ad04c-63df-42d1-9f05-c85d10c264e0 req-99e1a5cb-2d4b-449c-8916-6fbdce287e16 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152400 Dec 16 14:45:44.288980 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 378/735] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:44.457022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:44.458957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:44.483671 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:44.485418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:44.486996 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:44.487651 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:44.545597 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-374278e3-7675-4fce-ade0-08c9a85ff10c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:44.557609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-374278e3-7675-4fce-ade0-08c9a85ff10c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.455464 Dec 16 14:45:44.560010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 358/736] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:44 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:44.600924 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:44.601363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:44.601807 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lazy-loading 'fault' on Instance uuid 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:45:44.666640 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:44.681797 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:44.688907 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:44.690070 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-bcc21255-ffd2-46a4-8c95-072871c0d439 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 200 len: 1371 microversion: 2.20 time: 0.254483 Dec 16 14:45:44.690630 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 379/737] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:44 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:45.058975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-27140165-cf67-4e5e-b80f-76720c143bb7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:45.060100 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-27140165-cf67-4e5e-b80f-76720c143bb7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:45.070280 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-27140165-cf67-4e5e-b80f-76720c143bb7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:45.071048 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-27140165-cf67-4e5e-b80f-76720c143bb7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:45.072401 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-27140165-cf67-4e5e-b80f-76720c143bb7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:45.073173 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-27140165-cf67-4e5e-b80f-76720c143bb7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:45.281606 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-27140165-cf67-4e5e-b80f-76720c143bb7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:45.291839 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-27140165-cf67-4e5e-b80f-76720c143bb7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1232 microversion: 2.1 time: 0.251146 Dec 16 14:45:45.299776 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 359/738] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:45 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1232 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:45.595659 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a47313fe-39d9-416a-9b93-264521b047db tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:45.597718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a47313fe-39d9-416a-9b93-264521b047db tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:45.614294 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a47313fe-39d9-416a-9b93-264521b047db tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:45.615391 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a47313fe-39d9-416a-9b93-264521b047db tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:45.616585 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a47313fe-39d9-416a-9b93-264521b047db tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:45.617233 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a47313fe-39d9-416a-9b93-264521b047db tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:45.731808 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b7d5cc65-be71-4ba8-b251-f854435646b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:45.733916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b7d5cc65-be71-4ba8-b251-f854435646b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:45.758890 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b7d5cc65-be71-4ba8-b251-f854435646b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:45.760930 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b7d5cc65-be71-4ba8-b251-f854435646b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:45.763075 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b7d5cc65-be71-4ba8-b251-f854435646b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:45.764094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b7d5cc65-be71-4ba8-b251-f854435646b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:45.869102 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-b7d5cc65-be71-4ba8-b251-f854435646b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] HTTP exception thrown: Instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 could not be found. Dec 16 14:45:45.869806 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b7d5cc65-be71-4ba8-b251-f854435646b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Returning 404 to user: Instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:45:45.872156 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b7d5cc65-be71-4ba8-b251-f854435646b8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 404 len: 111 microversion: 2.20 time: 0.159120 Dec 16 14:45:45.873548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 360/739] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:45 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:45:45.897523 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a4be667b-75f2-47c0-9d6c-63391de29a3c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '.version_select at 0x7f26fe4cea60>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:45.953248 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a4be667b-75f2-47c0-9d6c-63391de29a3c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229192028" status: 204 len: 0 microversion: 2.20 time: 0.067534 Dec 16 14:45:45.954020 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 361/740] 10.222.0.67 () {60 vars in 1261 bytes} [Thu Dec 16 14:45:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229192028 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:45:46.023297 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a47313fe-39d9-416a-9b93-264521b047db tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:46.042839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a47313fe-39d9-416a-9b93-264521b047db tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.468634 Dec 16 14:45:46.058052 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 380/741] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:45 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:46.354811 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-c3a1b2f8-3965-41bc-9e87-639859a6083a req-86322334-4e64-4cab-85d8-fb8185c8d748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f3f655-81f2-49a1-8ae3-1961c329487b", "name": "network-vif-plugged", "status": "completed", "tag": "a286353e-4b59-4c95-8963-0d90f65f6f8b"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:46.364967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-37b1b5f4-4945-422b-87b9-3de819696568 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:46.379692 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-37b1b5f4-4945-422b-87b9-3de819696568 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:46.405004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:46.405004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:45:46.409529 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-37b1b5f4-4945-422b-87b9-3de819696568 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:46.413467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-37b1b5f4-4945-422b-87b9-3de819696568 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:46.415248 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-37b1b5f4-4945-422b-87b9-3de819696568 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:46.417438 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-37b1b5f4-4945-422b-87b9-3de819696568 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:46.443655 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-c3a1b2f8-3965-41bc-9e87-639859a6083a req-86322334-4e64-4cab-85d8-fb8185c8d748 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:46.444897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-c3a1b2f8-3965-41bc-9e87-639859a6083a req-86322334-4e64-4cab-85d8-fb8185c8d748 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:46.523030 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-c3a1b2f8-3965-41bc-9e87-639859a6083a req-86322334-4e64-4cab-85d8-fb8185c8d748 service nova] Creating event network-vif-plugged:a286353e-4b59-4c95-8963-0d90f65f6f8b for instance 65f3f655-81f2-49a1-8ae3-1961c329487b on hv-cinder-82189 Dec 16 14:45:46.540975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-c3a1b2f8-3965-41bc-9e87-639859a6083a req-86322334-4e64-4cab-85d8-fb8185c8d748 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229012 Dec 16 14:45:46.549109 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 381/742] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:46.800046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-37b1b5f4-4945-422b-87b9-3de819696568 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:46.818858 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-37b1b5f4-4945-422b-87b9-3de819696568 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1306 microversion: 2.1 time: 0.512148 Dec 16 14:45:46.820133 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 362/743] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:46 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1306 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:46.967948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-33c8ea27-afc5-4801-88d6-0ab301894ef4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:46.969225 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-33c8ea27-afc5-4801-88d6-0ab301894ef4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:46.977358 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-33c8ea27-afc5-4801-88d6-0ab301894ef4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:46.977822 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-33c8ea27-afc5-4801-88d6-0ab301894ef4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:46.978641 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-33c8ea27-afc5-4801-88d6-0ab301894ef4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:46.979065 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-33c8ea27-afc5-4801-88d6-0ab301894ef4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:47.124077 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f12843c9-41e0-4368-b92a-cf505f499246 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:47.134291 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f12843c9-41e0-4368-b92a-cf505f499246 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:47.149595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f12843c9-41e0-4368-b92a-cf505f499246 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:47.163164 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f12843c9-41e0-4368-b92a-cf505f499246 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:47.164965 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f12843c9-41e0-4368-b92a-cf505f499246 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:47.165946 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f12843c9-41e0-4368-b92a-cf505f499246 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:47.368433 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-33c8ea27-afc5-4801-88d6-0ab301894ef4 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76/os-volume_attachments/44fe3856-ee71-4c31-b13a-5b92e2c02d45" status: 202 len: 0 microversion: 2.1 time: 0.411784 Dec 16 14:45:47.369436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 382/744] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:45:46 2021] DELETE /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76/os-volume_attachments/44fe3856-ee71-4c31-b13a-5b92e2c02d45 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:45:47.722757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f12843c9-41e0-4368-b92a-cf505f499246 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:47.744002 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f12843c9-41e0-4368-b92a-cf505f499246 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.672587 Dec 16 14:45:47.745672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 363/745] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:47 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:47.856732 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-949639f3-5369-40ac-b41d-cb1426dda904 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:47.864919 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-949639f3-5369-40ac-b41d-cb1426dda904 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:47.873939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-949639f3-5369-40ac-b41d-cb1426dda904 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:47.874736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-949639f3-5369-40ac-b41d-cb1426dda904 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:47.875711 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-949639f3-5369-40ac-b41d-cb1426dda904 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:47.876481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-949639f3-5369-40ac-b41d-cb1426dda904 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:48.047035 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-949639f3-5369-40ac-b41d-cb1426dda904 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:48.060003 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-949639f3-5369-40ac-b41d-cb1426dda904 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1294 microversion: 2.1 time: 0.215238 Dec 16 14:45:48.060583 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 383/746] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:47 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1294 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:48.363920 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-df6cd42a-30ff-4e73-85a9-a30ee73486a2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'create', calling method: .version_select at 0x7f26fe29b040>, body: {"keypair": {"name": "tempest-keypair-239600633"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:48.406999 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-df6cd42a-30ff-4e73-85a9-a30ee73486a2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for project 198be39f56934fc58b1c76e532336733. Resources: {'key_pairs'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:45:48.412408 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-df6cd42a-30ff-4e73-85a9-a30ee73486a2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for user 0d72966786b641f48edda655d2d0ba45 and project 198be39f56934fc58b1c76e532336733. Resources: {'key_pairs'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:45:48.710349 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-df6cd42a-30ff-4e73-85a9-a30ee73486a2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for project 198be39f56934fc58b1c76e532336733. Resources: {'key_pairs'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:45:48.716627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-df6cd42a-30ff-4e73-85a9-a30ee73486a2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for user 0d72966786b641f48edda655d2d0ba45 and project 198be39f56934fc58b1c76e532336733. Resources: {'key_pairs'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:45:48.738004 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-df6cd42a-30ff-4e73-85a9-a30ee73486a2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.391244 Dec 16 14:45:48.742151 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 364/747] 10.222.0.67 () {62 vars in 1198 bytes} [Thu Dec 16 14:45:48 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 400 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:45:48.774247 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-aebcf383-66fd-4111-adde-9f56a2927300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:48.775014 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-aebcf383-66fd-4111-adde-9f56a2927300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:48.784841 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-aebcf383-66fd-4111-adde-9f56a2927300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:48.785612 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-aebcf383-66fd-4111-adde-9f56a2927300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:48.786809 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-aebcf383-66fd-4111-adde-9f56a2927300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:48.788125 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-aebcf383-66fd-4111-adde-9f56a2927300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:49.087920 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-33b30363-3d1f-4836-97f0-66aca61c8f9c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:49.089058 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-33b30363-3d1f-4836-97f0-66aca61c8f9c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:49.099252 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-33b30363-3d1f-4836-97f0-66aca61c8f9c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:49.099692 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-33b30363-3d1f-4836-97f0-66aca61c8f9c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:49.101387 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-33b30363-3d1f-4836-97f0-66aca61c8f9c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:49.101387 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-33b30363-3d1f-4836-97f0-66aca61c8f9c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:49.359256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-aebcf383-66fd-4111-adde-9f56a2927300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:49.376894 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-aebcf383-66fd-4111-adde-9f56a2927300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1356 microversion: 2.1 time: 0.617649 Dec 16 14:45:49.380313 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 384/748] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:48 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1356 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:49.786146 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-33b30363-3d1f-4836-97f0-66aca61c8f9c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:49.796765 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-33b30363-3d1f-4836-97f0-66aca61c8f9c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.723533 Dec 16 14:45:49.797352 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 365/749] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:49 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:49.948284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-273c2e61-56f7-4b62-9469-478f8fc6eefe tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:49.949384 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-273c2e61-56f7-4b62-9469-478f8fc6eefe tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:49.960414 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-273c2e61-56f7-4b62-9469-478f8fc6eefe tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:49.961002 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-273c2e61-56f7-4b62-9469-478f8fc6eefe tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:49.962074 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-273c2e61-56f7-4b62-9469-478f8fc6eefe tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:49.962705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-273c2e61-56f7-4b62-9469-478f8fc6eefe tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:49.998727 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-c913a6a8-fddc-42bb-9fd2-c5c6141e90dd req-385295bf-eaf9-4dfe-9377-7848bc6f615f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8693cb4-e6b1-4956-a996-04effeb71f79", "tag": "87c2d9a0-97d2-4890-8290-54947fa974e9"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:50.012924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:50.012924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:45:50.030902 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-c913a6a8-fddc-42bb-9fd2-c5c6141e90dd req-385295bf-eaf9-4dfe-9377-7848bc6f615f service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.031701 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-c913a6a8-fddc-42bb-9fd2-c5c6141e90dd req-385295bf-eaf9-4dfe-9377-7848bc6f615f service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.071295 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-c913a6a8-fddc-42bb-9fd2-c5c6141e90dd req-385295bf-eaf9-4dfe-9377-7848bc6f615f service nova] Creating event network-changed:87c2d9a0-97d2-4890-8290-54947fa974e9 for instance a8693cb4-e6b1-4956-a996-04effeb71f79 on hv-cinder-82189 Dec 16 14:45:50.083471 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-c913a6a8-fddc-42bb-9fd2-c5c6141e90dd req-385295bf-eaf9-4dfe-9377-7848bc6f615f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104377 Dec 16 14:45:50.086147 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 366/750] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:45:50.141188 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-273c2e61-56f7-4b62-9469-478f8fc6eefe tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Going to try to terminate instance {{(pid=96670) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:45:50.339991 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-273c2e61-56f7-4b62-9469-478f8fc6eefe tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 204 len: 0 microversion: 2.1 time: 0.400744 Dec 16 14:45:50.343414 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 385/751] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:45:49 2021] DELETE /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:45:50.364048 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-39eb1c4c-9000-4ee0-b1bf-74360494736f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:50.364836 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-39eb1c4c-9000-4ee0-b1bf-74360494736f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:50.373667 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-39eb1c4c-9000-4ee0-b1bf-74360494736f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.374323 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-39eb1c4c-9000-4ee0-b1bf-74360494736f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.375364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-39eb1c4c-9000-4ee0-b1bf-74360494736f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.375980 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-39eb1c4c-9000-4ee0-b1bf-74360494736f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.402674 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-041cb6e6-539f-4344-bb93-4ad981ef1016 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:50.404094 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-041cb6e6-539f-4344-bb93-4ad981ef1016 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:50.413253 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-041cb6e6-539f-4344-bb93-4ad981ef1016 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.414138 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-041cb6e6-539f-4344-bb93-4ad981ef1016 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.415175 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-041cb6e6-539f-4344-bb93-4ad981ef1016 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.415760 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-041cb6e6-539f-4344-bb93-4ad981ef1016 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.780581 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-39eb1c4c-9000-4ee0-b1bf-74360494736f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:50.791731 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-39eb1c4c-9000-4ee0-b1bf-74360494736f tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1513 microversion: 2.1 time: 0.441606 Dec 16 14:45:50.799580 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 367/752] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:50 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1513 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:50.813900 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-041cb6e6-539f-4344-bb93-4ad981ef1016 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:50.821655 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-abcd1724-3d8c-49f3-aa21-32d85f6463b4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:50.822316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-abcd1724-3d8c-49f3-aa21-32d85f6463b4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:50.824999 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-041cb6e6-539f-4344-bb93-4ad981ef1016 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1546 microversion: 2.1 time: 0.432769 Dec 16 14:45:50.825951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 386/753] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:50 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1546 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:50.832447 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-abcd1724-3d8c-49f3-aa21-32d85f6463b4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.832922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-abcd1724-3d8c-49f3-aa21-32d85f6463b4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.833720 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-abcd1724-3d8c-49f3-aa21-32d85f6463b4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.834211 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-abcd1724-3d8c-49f3-aa21-32d85f6463b4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.853775 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e1459f6a-8344-489d-8985-a702b0c5cd9d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:50.854476 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e1459f6a-8344-489d-8985-a702b0c5cd9d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:50.874506 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1459f6a-8344-489d-8985-a702b0c5cd9d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.875771 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1459f6a-8344-489d-8985-a702b0c5cd9d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.877791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1459f6a-8344-489d-8985-a702b0c5cd9d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.878996 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1459f6a-8344-489d-8985-a702b0c5cd9d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.194668 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-abcd1724-3d8c-49f3-aa21-32d85f6463b4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:51.210048 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-abcd1724-3d8c-49f3-aa21-32d85f6463b4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.397744 Dec 16 14:45:51.212704 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 368/754] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:50 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:51.587495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e1459f6a-8344-489d-8985-a702b0c5cd9d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:51.600150 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e1459f6a-8344-489d-8985-a702b0c5cd9d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1546 microversion: 2.1 time: 0.761377 Dec 16 14:45:51.600734 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 387/755] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:50 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1546 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:51.622206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-bb0f40ac-d652-496a-b150-42f5cd67eb78 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:51.636244 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:51.636244 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:45:51.638115 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bb0f40ac-d652-496a-b150-42f5cd67eb78 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:51.638893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-bb0f40ac-d652-496a-b150-42f5cd67eb78 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Searching by: {'deleted': False, 'project_id': '7210fc0bdd80446484aaf7f436c2317b'} {{(pid=96669) get_all /opt/stack/nova/nova/compute/api.py:2852}} Dec 16 14:45:51.644610 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bb0f40ac-d652-496a-b150-42f5cd67eb78 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.645046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bb0f40ac-d652-496a-b150-42f5cd67eb78 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.645824 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bb0f40ac-d652-496a-b150-42f5cd67eb78 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.646288 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bb0f40ac-d652-496a-b150-42f5cd67eb78 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.748111 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.multi_cell_list [None req-bb0f40ac-d652-496a-b150-42f5cd67eb78 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=96669) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Dec 16 14:45:51.816983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-44f99001-90cd-4292-a362-65416ea7f454 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:51.817888 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-44f99001-90cd-4292-a362-65416ea7f454 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:51.827608 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44f99001-90cd-4292-a362-65416ea7f454 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.828052 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44f99001-90cd-4292-a362-65416ea7f454 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.829012 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44f99001-90cd-4292-a362-65416ea7f454 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.829607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-44f99001-90cd-4292-a362-65416ea7f454 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.858485 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-bb0f40ac-d652-496a-b150-42f5cd67eb78 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.245986 Dec 16 14:45:51.859454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 369/756] 10.222.0.67 () {58 vars in 1124 bytes} [Thu Dec 16 14:45:51 2021] GET /compute/v2.1/servers => generated 342 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:51.879561 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b4c0e5c0-a349-463e-98dd-6ddd99f91a34 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:51.880321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b4c0e5c0-a349-463e-98dd-6ddd99f91a34 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:51.889321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b4c0e5c0-a349-463e-98dd-6ddd99f91a34 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.889848 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b4c0e5c0-a349-463e-98dd-6ddd99f91a34 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.890737 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b4c0e5c0-a349-463e-98dd-6ddd99f91a34 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.891493 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b4c0e5c0-a349-463e-98dd-6ddd99f91a34 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:52.194923 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-44f99001-90cd-4292-a362-65416ea7f454 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:52.204023 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-44f99001-90cd-4292-a362-65416ea7f454 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1513 microversion: 2.1 time: 0.397306 Dec 16 14:45:52.204603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 388/757] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:51 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1513 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:52.216758 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1497433707", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fdb01c2-4dfe-48d4-ba53-23a0b176f0fb"}], "security_groups": [{"name": "tempest-securitygroup--728423112"}], "key_name": "tempest-keypair-239600633", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:52.298874 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b4c0e5c0-a349-463e-98dd-6ddd99f91a34 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:52.308229 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b4c0e5c0-a349-463e-98dd-6ddd99f91a34 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1546 microversion: 2.1 time: 0.440134 Dec 16 14:45:52.309367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 370/758] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:51 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1546 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:52.319521 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f54a08b2-66f8-4174-867a-17024326f803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:52.320949 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f54a08b2-66f8-4174-867a-17024326f803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:52.328508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f54a08b2-66f8-4174-867a-17024326f803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:52.329094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f54a08b2-66f8-4174-867a-17024326f803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:52.330145 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f54a08b2-66f8-4174-867a-17024326f803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:52.330658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f54a08b2-66f8-4174-867a-17024326f803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:52.372544 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.network.neutron [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] validate_networks() for [('2fdb01c2-4dfe-48d4-ba53-23a0b176f0fb', None, None, None)] {{(pid=96670) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:45:52.693846 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f54a08b2-66f8-4174-867a-17024326f803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:52.706871 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f54a08b2-66f8-4174-867a-17024326f803 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.396512 Dec 16 14:45:52.707784 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 371/759] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:52 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:53.145586 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Flavor limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:45:53.146634 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Image limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:45:53.146634 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Flavor pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:45:53.146975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Image pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:45:53.147147 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:45:53.157548 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.158010 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:53.158847 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.159287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:53.189709 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for project 198be39f56934fc58b1c76e532336733. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:45:53.197828 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Getting quotas for user 0d72966786b641f48edda655d2d0ba45 and project 198be39f56934fc58b1c76e532336733. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:45:53.212112 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Going to run 1 instances... {{(pid=96670) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:45:53.215006 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:45:53.226906 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5a41427c-2233-4ca1-881b-9dea0b8b3b15 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:53.227798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5a41427c-2233-4ca1-881b-9dea0b8b3b15 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:53.236297 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5a41427c-2233-4ca1-881b-9dea0b8b3b15 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.236743 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5a41427c-2233-4ca1-881b-9dea0b8b3b15 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:53.237878 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5a41427c-2233-4ca1-881b-9dea0b8b3b15 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.238339 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5a41427c-2233-4ca1-881b-9dea0b8b3b15 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:53.273352 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7219f7e2-b3d7-47af-98d9-81d6cc94596d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.066727 Dec 16 14:45:53.274745 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 389/760] 10.222.0.67 () {62 vars in 1187 bytes} [Thu Dec 16 14:45:52 2021] POST /compute/v2.1/servers => generated 401 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 16 14:45:53.306714 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-13dda8ad-31ef-4268-a0ca-023279be326f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:53.308136 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-13dda8ad-31ef-4268-a0ca-023279be326f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:53.402038 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-13dda8ad-31ef-4268-a0ca-023279be326f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:53.420921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-13dda8ad-31ef-4268-a0ca-023279be326f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:53.430610 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-13dda8ad-31ef-4268-a0ca-023279be326f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:53.430610 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-13dda8ad-31ef-4268-a0ca-023279be326f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1281 microversion: 2.20 time: 0.147174 Dec 16 14:45:53.438168 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 390/761] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:53 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:53.631483 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-deba8cd7-8368-4dd3-8121-e30f813b4b41 req-786f9b17-0737-4a6b-b826-c0d836b5505c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1747dc01-042a-43ca-af34-0f592eb34e76", "name": "network-vif-deleted", "tag": "61d17c21-dd75-4cdb-8c24-c439e4185bf1"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:53.640257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:53.640257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:45:53.654827 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-deba8cd7-8368-4dd3-8121-e30f813b4b41 req-786f9b17-0737-4a6b-b826-c0d836b5505c service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.655758 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-deba8cd7-8368-4dd3-8121-e30f813b4b41 req-786f9b17-0737-4a6b-b826-c0d836b5505c service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:53.680297 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-deba8cd7-8368-4dd3-8121-e30f813b4b41 req-786f9b17-0737-4a6b-b826-c0d836b5505c service nova] Creating event network-vif-deleted:61d17c21-dd75-4cdb-8c24-c439e4185bf1 for instance 1747dc01-042a-43ca-af34-0f592eb34e76 on hv-cinder-82189 Dec 16 14:45:53.687589 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-deba8cd7-8368-4dd3-8121-e30f813b4b41 req-786f9b17-0737-4a6b-b826-c0d836b5505c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069375 Dec 16 14:45:53.688957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 391/762] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:45:53.707375 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5a41427c-2233-4ca1-881b-9dea0b8b3b15 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62521c33250d4e528a7c1edd5c0dda0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '841e959321694bbe969318fafd7f676b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:53.729516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5a41427c-2233-4ca1-881b-9dea0b8b3b15 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 200 len: 1513 microversion: 2.1 time: 0.511931 Dec 16 14:45:53.730269 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 372/763] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:53 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 1513 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:53.749821 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-890a4215-d34a-4ad3-91f2-66122bfb38a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:53.758578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-890a4215-d34a-4ad3-91f2-66122bfb38a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:53.778041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-890a4215-d34a-4ad3-91f2-66122bfb38a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.778041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-890a4215-d34a-4ad3-91f2-66122bfb38a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:53.778041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-890a4215-d34a-4ad3-91f2-66122bfb38a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.778041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-890a4215-d34a-4ad3-91f2-66122bfb38a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:54.184799 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-890a4215-d34a-4ad3-91f2-66122bfb38a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:54.202488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-890a4215-d34a-4ad3-91f2-66122bfb38a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.474049 Dec 16 14:45:54.203749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 392/764] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:53 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:54.465518 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:54.466633 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:54.480576 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:54.481324 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:54.482756 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:54.483572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:54.535363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9fd37be2-3cf1-4088-b800-6cdb912adf1b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0b57206-6e00-4b3e-bd8c-92bec07610a2"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:54.536518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9fd37be2-3cf1-4088-b800-6cdb912adf1b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:54.547369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9fd37be2-3cf1-4088-b800-6cdb912adf1b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:54.548259 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9fd37be2-3cf1-4088-b800-6cdb912adf1b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:54.549346 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9fd37be2-3cf1-4088-b800-6cdb912adf1b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:54.550063 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9fd37be2-3cf1-4088-b800-6cdb912adf1b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:54.775783 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:54.807684 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:54.825091 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:54.828919 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d48bf5f1-d1cc-4d6b-a675-ac704ee41c53 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1277 microversion: 2.20 time: 0.381257 Dec 16 14:45:54.830660 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 373/765] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:54 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1277 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:54.860086 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ca48e28b-b1ba-4b26-8efb-6baa511ceb80 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:54.861015 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ca48e28b-b1ba-4b26-8efb-6baa511ceb80 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] [instance: 1747dc01-042a-43ca-af34-0f592eb34e76] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:54.887724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ca48e28b-b1ba-4b26-8efb-6baa511ceb80 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:54.889402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ca48e28b-b1ba-4b26-8efb-6baa511ceb80 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:54.891533 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ca48e28b-b1ba-4b26-8efb-6baa511ceb80 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:54.892863 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ca48e28b-b1ba-4b26-8efb-6baa511ceb80 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:55.054531 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-ca48e28b-b1ba-4b26-8efb-6baa511ceb80 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] HTTP exception thrown: Instance 1747dc01-042a-43ca-af34-0f592eb34e76 could not be found. Dec 16 14:45:55.055373 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ca48e28b-b1ba-4b26-8efb-6baa511ceb80 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] Returning 404 to user: Instance 1747dc01-042a-43ca-af34-0f592eb34e76 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:45:55.057078 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ca48e28b-b1ba-4b26-8efb-6baa511ceb80 tempest-VolumesSnapshotTestJSON-789635268 tempest-VolumesSnapshotTestJSON-789635268-project] 10.222.0.67 "GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76" status: 404 len: 111 microversion: 2.1 time: 0.223290 Dec 16 14:45:55.058420 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 374/766] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:54 2021] GET /compute/v2.1/servers/1747dc01-042a-43ca-af34-0f592eb34e76 => generated 111 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:45:55.205519 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9fd37be2-3cf1-4088-b800-6cdb912adf1b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "POST /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680154 Dec 16 14:45:55.210056 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 393/767] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:45:54 2021] POST /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments => generated 194 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:55.229845 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1bbedc6a-2bc0-453c-80f3-45f123df8153 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:55.230643 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1bbedc6a-2bc0-453c-80f3-45f123df8153 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:55.244881 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bbedc6a-2bc0-453c-80f3-45f123df8153 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:55.245580 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bbedc6a-2bc0-453c-80f3-45f123df8153 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:55.246987 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bbedc6a-2bc0-453c-80f3-45f123df8153 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:55.247719 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bbedc6a-2bc0-453c-80f3-45f123df8153 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:55.693394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1bbedc6a-2bc0-453c-80f3-45f123df8153 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:55.713551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1bbedc6a-2bc0-453c-80f3-45f123df8153 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.495671 Dec 16 14:45:55.714559 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 375/768] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:55 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:55.871486 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:55.872291 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:55.882222 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:55.882810 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:55.883803 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:55.884338 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:56.019496 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:56.042639 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:56.049264 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:56.050461 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-88da43f3-e34d-46e4-918c-f75aef521b96 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1339 microversion: 2.20 time: 0.189859 Dec 16 14:45:56.051362 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 394/769] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:55 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:56.754402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0c632cb3-96cc-40d6-92cc-f939bb8be28f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:56.755146 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0c632cb3-96cc-40d6-92cc-f939bb8be28f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:56.764275 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c632cb3-96cc-40d6-92cc-f939bb8be28f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:56.764872 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c632cb3-96cc-40d6-92cc-f939bb8be28f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:56.765779 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c632cb3-96cc-40d6-92cc-f939bb8be28f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:56.766798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c632cb3-96cc-40d6-92cc-f939bb8be28f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:57.078964 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:57.080347 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:57.097292 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:57.098566 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:57.100693 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:57.101972 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:57.246750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-0c632cb3-96cc-40d6-92cc-f939bb8be28f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:57.270071 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0c632cb3-96cc-40d6-92cc-f939bb8be28f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.530249 Dec 16 14:45:57.270986 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 376/770] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:56 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:57.557895 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:57.579389 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:57.587656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:57.589337 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0cab67a8-554f-49a6-b647-fa9247ec92f9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.523448 Dec 16 14:45:57.601711 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 395/771] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:57 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:57.978562 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-82c8e7d8-8bf8-4405-afcf-b4e163dea4d5 req-de75e9dd-bb7f-43c8-b842-c7ec5e4499d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8693cb4-e6b1-4956-a996-04effeb71f79", "name": "network-vif-plugged", "status": "completed", "tag": "87c2d9a0-97d2-4890-8290-54947fa974e9"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:57.986383 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:57.986383 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:45:58.002693 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-82c8e7d8-8bf8-4405-afcf-b4e163dea4d5 req-de75e9dd-bb7f-43c8-b842-c7ec5e4499d9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:58.003601 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-82c8e7d8-8bf8-4405-afcf-b4e163dea4d5 req-de75e9dd-bb7f-43c8-b842-c7ec5e4499d9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:58.036873 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-82c8e7d8-8bf8-4405-afcf-b4e163dea4d5 req-de75e9dd-bb7f-43c8-b842-c7ec5e4499d9 service nova] Creating event network-vif-plugged:87c2d9a0-97d2-4890-8290-54947fa974e9 for instance a8693cb4-e6b1-4956-a996-04effeb71f79 on hv-cinder-82189 Dec 16 14:45:58.047911 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-82c8e7d8-8bf8-4405-afcf-b4e163dea4d5 req-de75e9dd-bb7f-43c8-b842-c7ec5e4499d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086216 Dec 16 14:45:58.048936 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 377/772] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:58.300163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3dd4a5b6-39a1-46fd-aaee-dc328061cbc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:58.300163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3dd4a5b6-39a1-46fd-aaee-dc328061cbc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:58.310518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3dd4a5b6-39a1-46fd-aaee-dc328061cbc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:58.311261 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3dd4a5b6-39a1-46fd-aaee-dc328061cbc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:58.312165 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3dd4a5b6-39a1-46fd-aaee-dc328061cbc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:58.312895 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3dd4a5b6-39a1-46fd-aaee-dc328061cbc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:58.374383 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-74c8b27c-d14b-4b7f-ae52-d4756d87ee0f req-e39599ea-7763-4ee8-b30f-95c8122f43e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd517a0-bd8a-4e52-93ac-304678993d24", "tag": "89eb0392-5a52-4cad-8793-177f104836c0"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:58.387749 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:58.387749 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:45:58.400196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-74c8b27c-d14b-4b7f-ae52-d4756d87ee0f req-e39599ea-7763-4ee8-b30f-95c8122f43e3 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:58.400680 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-74c8b27c-d14b-4b7f-ae52-d4756d87ee0f req-e39599ea-7763-4ee8-b30f-95c8122f43e3 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:58.420692 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-74c8b27c-d14b-4b7f-ae52-d4756d87ee0f req-e39599ea-7763-4ee8-b30f-95c8122f43e3 service nova] Creating event network-changed:89eb0392-5a52-4cad-8793-177f104836c0 for instance 1bd517a0-bd8a-4e52-93ac-304678993d24 on hv-cinder-82189 Dec 16 14:45:58.426122 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-74c8b27c-d14b-4b7f-ae52-d4756d87ee0f req-e39599ea-7763-4ee8-b30f-95c8122f43e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074302 Dec 16 14:45:58.427011 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 378/773] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:58.582714 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3dd4a5b6-39a1-46fd-aaee-dc328061cbc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:58.591859 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3dd4a5b6-39a1-46fd-aaee-dc328061cbc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.304841 Dec 16 14:45:58.592417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 396/774] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:58 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:58.616411 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:58.617204 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:58.626068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:58.626514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:58.627618 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:58.628038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:58.988699 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:59.004177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:59.010899 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:59.012217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7ce1740f-34ec-4413-b3b0-c3e82ab4287a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.406882 Dec 16 14:45:59.013030 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 379/775] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:58 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:59.615420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-791c1328-25a9-40af-8c77-ce2d05b32aab tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:59.616137 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-791c1328-25a9-40af-8c77-ce2d05b32aab tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:45:59.624393 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-791c1328-25a9-40af-8c77-ce2d05b32aab tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:59.624861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-791c1328-25a9-40af-8c77-ce2d05b32aab tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:59.625650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-791c1328-25a9-40af-8c77-ce2d05b32aab tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:59.626116 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-791c1328-25a9-40af-8c77-ce2d05b32aab tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:59.903723 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-791c1328-25a9-40af-8c77-ce2d05b32aab tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:45:59.912526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-791c1328-25a9-40af-8c77-ce2d05b32aab tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.307102 Dec 16 14:45:59.913081 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 397/776] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:59 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:00.041290 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:00.041950 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:00.051688 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:00.052155 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:00.052975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:00.053412 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:00.362474 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:00.381502 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:00.388374 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:00.389529 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-34f45259-a278-4e59-9046-ca1c1fc35ec7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.358946 Dec 16 14:46:00.390140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 380/777] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:00 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:00.943111 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fb6310d7-f40a-42da-b496-c5c3f4b6a713 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:00.943813 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fb6310d7-f40a-42da-b496-c5c3f4b6a713 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:00.952060 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb6310d7-f40a-42da-b496-c5c3f4b6a713 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:00.952540 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb6310d7-f40a-42da-b496-c5c3f4b6a713 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:00.953357 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb6310d7-f40a-42da-b496-c5c3f4b6a713 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:00.953862 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb6310d7-f40a-42da-b496-c5c3f4b6a713 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:01.224902 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-fb6310d7-f40a-42da-b496-c5c3f4b6a713 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:01.236323 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fb6310d7-f40a-42da-b496-c5c3f4b6a713 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.303308 Dec 16 14:46:01.236986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 398/778] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:00 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:01.430210 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:01.431285 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:01.452625 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:01.454243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:01.455578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:01.456242 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:01.948708 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:01.976016 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:01.991217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:01.993215 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f13ed5a0-0cbe-40c1-945f-5e443ea8ce83 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.578089 Dec 16 14:46:01.994237 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 381/779] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:01 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:02.270728 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8b9662b5-d8d5-405a-b987-98684f66cdd6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:02.271793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8b9662b5-d8d5-405a-b987-98684f66cdd6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:02.285904 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b9662b5-d8d5-405a-b987-98684f66cdd6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:02.286754 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b9662b5-d8d5-405a-b987-98684f66cdd6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:02.288180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b9662b5-d8d5-405a-b987-98684f66cdd6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:02.288955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b9662b5-d8d5-405a-b987-98684f66cdd6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:02.571323 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8b9662b5-d8d5-405a-b987-98684f66cdd6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:02.581435 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8b9662b5-d8d5-405a-b987-98684f66cdd6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.331063 Dec 16 14:46:02.582012 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 399/780] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:02 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:03.045847 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:03.048633 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:03.068035 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.068803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.070369 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.071507 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.469074 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:03.488064 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:03.500072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:03.501568 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f61a845e-0fb2-43a5-8ac9-470de1f7fffc tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.484779 Dec 16 14:46:03.516175 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 382/781] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:03 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:03.612285 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6f84edc1-8a47-4136-8470-731baf806879 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:03.613061 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6f84edc1-8a47-4136-8470-731baf806879 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:03.621359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6f84edc1-8a47-4136-8470-731baf806879 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.622304 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6f84edc1-8a47-4136-8470-731baf806879 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.623490 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6f84edc1-8a47-4136-8470-731baf806879 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.623955 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6f84edc1-8a47-4136-8470-731baf806879 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.908952 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6f84edc1-8a47-4136-8470-731baf806879 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:03.917846 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6f84edc1-8a47-4136-8470-731baf806879 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1361 microversion: 2.1 time: 0.318422 Dec 16 14:46:03.918462 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 400/782] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:03 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1361 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:04.532657 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:04.533136 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:04.541519 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.542117 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:04.542956 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.543465 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:04.742709 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f41c985e-4be4-4871-aa8d-c29678da6996 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:04.743330 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f41c985e-4be4-4871-aa8d-c29678da6996 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:04.751296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f41c985e-4be4-4871-aa8d-c29678da6996 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.751760 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f41c985e-4be4-4871-aa8d-c29678da6996 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:04.752847 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f41c985e-4be4-4871-aa8d-c29678da6996 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.753457 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f41c985e-4be4-4871-aa8d-c29678da6996 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:04.765526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:04.782566 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:04.789655 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:04.790794 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2d0b1022-429a-43f7-bc3f-3d3421f105cf tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.268247 Dec 16 14:46:04.791305 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 383/783] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:04 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:04.941778 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-580b0250-266d-4cc1-ba2f-ca93863f2ebd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:04.942693 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-580b0250-266d-4cc1-ba2f-ca93863f2ebd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:04.962096 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-580b0250-266d-4cc1-ba2f-ca93863f2ebd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.963376 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-580b0250-266d-4cc1-ba2f-ca93863f2ebd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:04.964824 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-580b0250-266d-4cc1-ba2f-ca93863f2ebd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.965874 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-580b0250-266d-4cc1-ba2f-ca93863f2ebd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:05.238231 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-580b0250-266d-4cc1-ba2f-ca93863f2ebd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:05.252988 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-580b0250-266d-4cc1-ba2f-ca93863f2ebd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1547 microversion: 2.1 time: 0.319538 Dec 16 14:46:05.254047 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 384/784] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:04 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1547 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:05.260400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f41c985e-4be4-4871-aa8d-c29678da6996 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:05.277662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-85a15b51-f26c-4fce-ab72-eca0ba540d96 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:05.278211 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f41c985e-4be4-4871-aa8d-c29678da6996 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1592 microversion: 2.1 time: 0.544757 Dec 16 14:46:05.278346 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-85a15b51-f26c-4fce-ab72-eca0ba540d96 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:05.286991 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 401/785] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:04 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1592 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:05.287295 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85a15b51-f26c-4fce-ab72-eca0ba540d96 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:05.287295 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85a15b51-f26c-4fce-ab72-eca0ba540d96 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:05.287957 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85a15b51-f26c-4fce-ab72-eca0ba540d96 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:05.288572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85a15b51-f26c-4fce-ab72-eca0ba540d96 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:05.515709 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-85a15b51-f26c-4fce-ab72-eca0ba540d96 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248535 Dec 16 14:46:05.516487 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 385/786] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Dec 16 14:46:05 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:46:05.815537 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:05.816167 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:05.823783 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:05.824221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:05.825238 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:05.825777 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:06.454236 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:06.470849 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:06.478404 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:06.479636 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-99cbd4e7-7cc5-476f-90fe-90742a0df774 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.674313 Dec 16 14:46:06.480171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 402/787] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:05 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:07.513442 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:07.514282 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:07.522315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:07.522729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:07.523497 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:07.523913 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:07.770171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:07.786350 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:07.793630 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:07.795781 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-623b2e81-af22-44a5-82d8-75a0d352fa5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.291976 Dec 16 14:46:07.796454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 386/788] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:07 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:08.825091 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:08.825787 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:08.833860 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:08.834603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:08.835620 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:08.836045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:09.048213 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f59f74c0-cb8c-4bef-bd34-6d494dff99e3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:09.049153 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f59f74c0-cb8c-4bef-bd34-6d494dff99e3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:09.057202 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f59f74c0-cb8c-4bef-bd34-6d494dff99e3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:09.057891 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f59f74c0-cb8c-4bef-bd34-6d494dff99e3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:09.058923 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f59f74c0-cb8c-4bef-bd34-6d494dff99e3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:09.059347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f59f74c0-cb8c-4bef-bd34-6d494dff99e3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:09.223946 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:09.239061 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:09.247424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:09.247424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5b50e351-3266-4a7b-83d2-771df8c9ba07 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.435652 Dec 16 14:46:09.254184 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 403/789] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:08 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:09.259210 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-82c1aad1-beb0-40a2-84d9-5079d637ebb1 req-f2bd473c-8789-481c-b5fd-12beff0d4eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8693cb4-e6b1-4956-a996-04effeb71f79", "tag": "87c2d9a0-97d2-4890-8290-54947fa974e9"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:09.266256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:09.266256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:46:09.274899 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-82c1aad1-beb0-40a2-84d9-5079d637ebb1 req-f2bd473c-8789-481c-b5fd-12beff0d4eef service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:09.275332 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-82c1aad1-beb0-40a2-84d9-5079d637ebb1 req-f2bd473c-8789-481c-b5fd-12beff0d4eef service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:09.293892 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-82c1aad1-beb0-40a2-84d9-5079d637ebb1 req-f2bd473c-8789-481c-b5fd-12beff0d4eef service nova] Creating event network-changed:87c2d9a0-97d2-4890-8290-54947fa974e9 for instance a8693cb4-e6b1-4956-a996-04effeb71f79 on hv-cinder-82189 Dec 16 14:46:09.299999 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-82c1aad1-beb0-40a2-84d9-5079d637ebb1 req-f2bd473c-8789-481c-b5fd-12beff0d4eef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050629 Dec 16 14:46:09.300874 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 404/790] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:10.293543 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:10.298279 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:10.318516 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:10.320560 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:10.322524 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:10.323647 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:10.699590 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:10.717775 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:10.726310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:10.728610 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-41696f9d-3e63-4b2e-92e2-4d55a8944d60 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.456286 Dec 16 14:46:10.739971 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 405/791] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:10 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:46:11.323970 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-ca68bdc0-40cb-45df-9052-26336d1daacd req-5a1ed6d0-a243-4a80-9d0f-f6ed10f6efab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f3f655-81f2-49a1-8ae3-1961c329487b", "tag": "a286353e-4b59-4c95-8963-0d90f65f6f8b"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:11.331577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:11.331577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:46:11.346331 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-ca68bdc0-40cb-45df-9052-26336d1daacd req-5a1ed6d0-a243-4a80-9d0f-f6ed10f6efab service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:11.346774 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-ca68bdc0-40cb-45df-9052-26336d1daacd req-5a1ed6d0-a243-4a80-9d0f-f6ed10f6efab service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:11.364739 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-ca68bdc0-40cb-45df-9052-26336d1daacd req-5a1ed6d0-a243-4a80-9d0f-f6ed10f6efab service nova] Creating event network-changed:a286353e-4b59-4c95-8963-0d90f65f6f8b for instance 65f3f655-81f2-49a1-8ae3-1961c329487b on hv-cinder-82189 Dec 16 14:46:11.373420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-ca68bdc0-40cb-45df-9052-26336d1daacd req-5a1ed6d0-a243-4a80-9d0f-f6ed10f6efab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059288 Dec 16 14:46:11.373828 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 406/792] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:11.758035 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:11.758897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:11.768663 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:11.769108 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:11.770126 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:11.770604 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:12.010041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:12.028378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:12.034982 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:12.036135 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e29cd87f-cd73-4145-927e-2551eae5e656 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.292970 Dec 16 14:46:12.036676 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 407/793] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:11 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:46:12.047470 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c6f8b232-caca-4ff9-b88f-f7e5e230c7ce tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-154229795"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:12.048035 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c6f8b232-caca-4ff9-b88f-f7e5e230c7ce tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:12.055944 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6f8b232-caca-4ff9-b88f-f7e5e230c7ce tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:12.056392 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6f8b232-caca-4ff9-b88f-f7e5e230c7ce tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:12.057184 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6f8b232-caca-4ff9-b88f-f7e5e230c7ce tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:12.057628 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6f8b232-caca-4ff9-b88f-f7e5e230c7ce tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:12.320144 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.network.security_group_api [None req-c6f8b232-caca-4ff9-b88f-f7e5e230c7ce tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Adding security group 2c7efa2f-6da1-49a8-9d90-17497c9c4b6f to port a286353e-4b59-4c95-8963-0d90f65f6f8b Dec 16 14:46:12.845026 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c6f8b232-caca-4ff9-b88f-f7e5e230c7ce tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "POST /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/action" status: 202 len: 0 microversion: 2.1 time: 0.807230 Dec 16 14:46:12.850499 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 408/794] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:12 2021] POST /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:12.865145 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-40301079-f4f9-4bc2-b5d4-79a35bb0444b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:12.865793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-40301079-f4f9-4bc2-b5d4-79a35bb0444b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:12.876080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40301079-f4f9-4bc2-b5d4-79a35bb0444b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:12.876526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40301079-f4f9-4bc2-b5d4-79a35bb0444b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:12.877304 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40301079-f4f9-4bc2-b5d4-79a35bb0444b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:12.877898 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-40301079-f4f9-4bc2-b5d4-79a35bb0444b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:13.142742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-40301079-f4f9-4bc2-b5d4-79a35bb0444b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:13.159701 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-40301079-f4f9-4bc2-b5d4-79a35bb0444b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1638 microversion: 2.1 time: 0.307553 Dec 16 14:46:13.174660 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 409/795] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:12 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1638 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:13.190410 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:13.191154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:13.200070 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:13.200696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:13.201861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:13.203036 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:13.452780 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:13.467598 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:13.474137 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:13.475258 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3e6430f5-2bb2-4664-9d05-47651f9237d0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.299561 Dec 16 14:46:13.475805 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 410/796] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:13 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:13.486155 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-79c5eec1-6500-45ad-aa82-ff7ee0a7fbb6 req-8da0878a-f718-49a0-9731-b64000760cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f3f655-81f2-49a1-8ae3-1961c329487b", "tag": "a286353e-4b59-4c95-8963-0d90f65f6f8b"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:13.492733 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:13.492733 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:46:13.506440 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-79c5eec1-6500-45ad-aa82-ff7ee0a7fbb6 req-8da0878a-f718-49a0-9731-b64000760cb7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:13.506886 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-79c5eec1-6500-45ad-aa82-ff7ee0a7fbb6 req-8da0878a-f718-49a0-9731-b64000760cb7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:13.523744 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-79c5eec1-6500-45ad-aa82-ff7ee0a7fbb6 req-8da0878a-f718-49a0-9731-b64000760cb7 service nova] Creating event network-changed:a286353e-4b59-4c95-8963-0d90f65f6f8b for instance 65f3f655-81f2-49a1-8ae3-1961c329487b on hv-cinder-82189 Dec 16 14:46:13.528588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-79c5eec1-6500-45ad-aa82-ff7ee0a7fbb6 req-8da0878a-f718-49a0-9731-b64000760cb7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051554 Dec 16 14:46:13.529230 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 411/797] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:13.685701 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f59f74c0-cb8c-4bef-bd34-6d494dff99e3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 14 microversion: 2.1 time: 4.647645 Dec 16 14:46:13.687244 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 387/798] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:09 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 14 bytes in 4651 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:46:14.508009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:14.510226 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:14.524007 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:14.525008 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:14.526646 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:14.527430 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:14.705541 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-84c8d7e3-b50b-4499-ab7d-6492bd20a021 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:14.707308 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-84c8d7e3-b50b-4499-ab7d-6492bd20a021 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:14.719602 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-84c8d7e3-b50b-4499-ab7d-6492bd20a021 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:14.720280 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-84c8d7e3-b50b-4499-ab7d-6492bd20a021 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:14.722524 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-84c8d7e3-b50b-4499-ab7d-6492bd20a021 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:14.723392 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-84c8d7e3-b50b-4499-ab7d-6492bd20a021 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:14.901500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:14.914308 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-84c8d7e3-b50b-4499-ab7d-6492bd20a021 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 14 microversion: 2.1 time: 0.218213 Dec 16 14:46:14.918019 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 388/799] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:14 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 14 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:46:14.926878 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:14.933814 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:14.935746 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b97593ad-4513-48c9-8449-912f81fa4f59 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.443917 Dec 16 14:46:14.936858 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 412/800] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:14 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:15.945133 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2a20e01f-2c3d-4146-bfac-7272b50642a3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:15.948041 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2a20e01f-2c3d-4146-bfac-7272b50642a3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:15.962083 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2a20e01f-2c3d-4146-bfac-7272b50642a3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:15.963300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2a20e01f-2c3d-4146-bfac-7272b50642a3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:15.964939 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2a20e01f-2c3d-4146-bfac-7272b50642a3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:15.965897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2a20e01f-2c3d-4146-bfac-7272b50642a3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:15.981488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:15.982545 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:15.995342 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:15.996120 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:15.998752 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:15.998752 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:16.158065 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2a20e01f-2c3d-4146-bfac-7272b50642a3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 14 microversion: 2.1 time: 0.234686 Dec 16 14:46:16.165146 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 389/801] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:15 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 14 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:46:16.333065 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:16.353653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:16.360730 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:16.362490 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-625bdc32-9fbb-4e48-9395-34775e5683c0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.400922 Dec 16 14:46:16.364094 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 413/802] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:15 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:46:16.394169 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-65977700-689a-495e-b56d-2e37e40ea0c6 req-ade2e47d-8d79-41a5-ae41-293742dbaec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd517a0-bd8a-4e52-93ac-304678993d24", "name": "network-vif-plugged", "status": "completed", "tag": "89eb0392-5a52-4cad-8793-177f104836c0"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:16.401123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:16.401123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:46:16.411442 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-65977700-689a-495e-b56d-2e37e40ea0c6 req-ade2e47d-8d79-41a5-ae41-293742dbaec9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:16.411781 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-65977700-689a-495e-b56d-2e37e40ea0c6 req-ade2e47d-8d79-41a5-ae41-293742dbaec9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:16.429609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-65977700-689a-495e-b56d-2e37e40ea0c6 req-ade2e47d-8d79-41a5-ae41-293742dbaec9 service nova] Creating event network-vif-plugged:89eb0392-5a52-4cad-8793-177f104836c0 for instance 1bd517a0-bd8a-4e52-93ac-304678993d24 on hv-cinder-82189 Dec 16 14:46:16.435016 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-65977700-689a-495e-b56d-2e37e40ea0c6 req-ade2e47d-8d79-41a5-ae41-293742dbaec9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056568 Dec 16 14:46:16.436033 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 390/803] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:16.721834 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-423e3ef3-cb49-4e5e-b787-dc33240c0f1d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:16.722406 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-423e3ef3-cb49-4e5e-b787-dc33240c0f1d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:16.731838 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-423e3ef3-cb49-4e5e-b787-dc33240c0f1d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:16.732778 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-423e3ef3-cb49-4e5e-b787-dc33240c0f1d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:16.733615 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-423e3ef3-cb49-4e5e-b787-dc33240c0f1d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:16.734086 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-423e3ef3-cb49-4e5e-b787-dc33240c0f1d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:16.811093 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-423e3ef3-cb49-4e5e-b787-dc33240c0f1d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lazy-loading 'flavor' on Instance uuid fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:46:17.010104 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-423e3ef3-cb49-4e5e-b787-dc33240c0f1d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "POST /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20/action" status: 202 len: 0 microversion: 2.1 time: 0.462624 Dec 16 14:46:17.011198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 414/804] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:16 2021] POST /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:17.027153 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3eede4e4-07a1-414c-af50-24d5170cf5b6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:17.028074 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3eede4e4-07a1-414c-af50-24d5170cf5b6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:17.039371 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3eede4e4-07a1-414c-af50-24d5170cf5b6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:17.040485 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3eede4e4-07a1-414c-af50-24d5170cf5b6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:17.040485 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3eede4e4-07a1-414c-af50-24d5170cf5b6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:17.040910 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3eede4e4-07a1-414c-af50-24d5170cf5b6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:17.180590 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-34c074f4-9a76-4db6-b78f-150c43d853b8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:17.181777 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-34c074f4-9a76-4db6-b78f-150c43d853b8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:17.192198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34c074f4-9a76-4db6-b78f-150c43d853b8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:17.192698 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34c074f4-9a76-4db6-b78f-150c43d853b8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:17.193472 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34c074f4-9a76-4db6-b78f-150c43d853b8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:17.193977 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-34c074f4-9a76-4db6-b78f-150c43d853b8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:17.315609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3eede4e4-07a1-414c-af50-24d5170cf5b6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:17.326070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3eede4e4-07a1-414c-af50-24d5170cf5b6 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.309647 Dec 16 14:46:17.326727 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 391/805] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:17 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:17.395787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:17.396499 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:17.410167 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:17.411288 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:17.412195 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:17.412802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:17.490561 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-34c074f4-9a76-4db6-b78f-150c43d853b8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 6060 microversion: 2.1 time: 0.319541 Dec 16 14:46:17.495857 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 415/806] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:17 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 6060 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:17.648406 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:17.663478 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:17.670017 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:17.671095 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8bdfdacb-f98b-463f-8a30-35d868b6a511 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.285133 Dec 16 14:46:17.671661 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 392/807] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:17 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:18.353719 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bda4195c-1d16-425a-a79b-c72b949b9f04 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:18.354589 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-bda4195c-1d16-425a-a79b-c72b949b9f04 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:18.366757 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bda4195c-1d16-425a-a79b-c72b949b9f04 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:18.367203 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bda4195c-1d16-425a-a79b-c72b949b9f04 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:18.368064 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bda4195c-1d16-425a-a79b-c72b949b9f04 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:18.368487 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bda4195c-1d16-425a-a79b-c72b949b9f04 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:18.520788 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b9621e0b-6c4c-49ca-ae44-a5212aa3eeee tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:18.522566 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b9621e0b-6c4c-49ca-ae44-a5212aa3eeee tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:18.530319 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b9621e0b-6c4c-49ca-ae44-a5212aa3eeee tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:18.531079 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b9621e0b-6c4c-49ca-ae44-a5212aa3eeee tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:18.532033 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b9621e0b-6c4c-49ca-ae44-a5212aa3eeee tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:18.532469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b9621e0b-6c4c-49ca-ae44-a5212aa3eeee tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:18.633688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bda4195c-1d16-425a-a79b-c72b949b9f04 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:18.650011 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-bda4195c-1d16-425a-a79b-c72b949b9f04 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.306311 Dec 16 14:46:18.650829 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 416/808] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:18 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:18.696336 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:18.697018 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:18.707128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:18.707128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:18.707815 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:18.708234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:18.720460 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b9621e0b-6c4c-49ca-ae44-a5212aa3eeee tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 14266 microversion: 2.1 time: 0.218061 Dec 16 14:46:18.726405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 393/809] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:18 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 14266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:18.995496 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:19.010680 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:19.017279 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:19.018437 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8f248204-35ae-4771-ace9-3d7072356603 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1406 microversion: 2.20 time: 0.332008 Dec 16 14:46:19.018982 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 417/810] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:18 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:46:19.682746 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8b61da17-a7fa-41f4-81a7-a5a873a706cd tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:19.683559 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8b61da17-a7fa-41f4-81a7-a5a873a706cd tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:19.692868 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b61da17-a7fa-41f4-81a7-a5a873a706cd tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:19.693314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b61da17-a7fa-41f4-81a7-a5a873a706cd tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:19.694177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b61da17-a7fa-41f4-81a7-a5a873a706cd tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:19.694610 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8b61da17-a7fa-41f4-81a7-a5a873a706cd tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:19.740615 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e16760c2-114d-435f-b5fc-b8496b53a4ea tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:19.741740 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e16760c2-114d-435f-b5fc-b8496b53a4ea tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:19.751227 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e16760c2-114d-435f-b5fc-b8496b53a4ea tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:19.751726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e16760c2-114d-435f-b5fc-b8496b53a4ea tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:19.752545 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e16760c2-114d-435f-b5fc-b8496b53a4ea tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:19.752970 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e16760c2-114d-435f-b5fc-b8496b53a4ea tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:19.894207 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e16760c2-114d-435f-b5fc-b8496b53a4ea tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 18356 microversion: 2.1 time: 0.162595 Dec 16 14:46:19.895360 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 418/811] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:19 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 18356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:19.939347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8b61da17-a7fa-41f4-81a7-a5a873a706cd tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:19.948406 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8b61da17-a7fa-41f4-81a7-a5a873a706cd tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.276414 Dec 16 14:46:19.948972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 394/812] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:19 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:20.053410 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:20.054392 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:20.063863 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:20.064308 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:20.065101 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:20.065528 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:20.371165 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:20.403615 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:20.410684 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:20.411825 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-81f67b32-eb8b-4fda-8bed-17ef266f0f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1599 microversion: 2.20 time: 0.371810 Dec 16 14:46:20.412376 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 419/813] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:20 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1599 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:20.445349 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d5c61f77-3d3f-4ef9-b520-da92cbb3245a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:20.445739 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d5c61f77-3d3f-4ef9-b520-da92cbb3245a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:20.454329 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5c61f77-3d3f-4ef9-b520-da92cbb3245a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:20.454882 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5c61f77-3d3f-4ef9-b520-da92cbb3245a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:20.455668 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5c61f77-3d3f-4ef9-b520-da92cbb3245a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:20.456215 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d5c61f77-3d3f-4ef9-b520-da92cbb3245a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:20.643047 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d5c61f77-3d3f-4ef9-b520-da92cbb3245a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.207457 Dec 16 14:46:20.643646 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 395/814] 10.222.0.67 () {60 vars in 1315 bytes} [Thu Dec 16 14:46:20 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:20.924614 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9ce1378e-1283-4934-b6f5-8f0005ffc970 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:20.926397 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9ce1378e-1283-4934-b6f5-8f0005ffc970 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:20.941337 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ce1378e-1283-4934-b6f5-8f0005ffc970 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:20.942364 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ce1378e-1283-4934-b6f5-8f0005ffc970 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:20.943813 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ce1378e-1283-4934-b6f5-8f0005ffc970 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:20.944567 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ce1378e-1283-4934-b6f5-8f0005ffc970 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:20.978720 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4cf27fc8-6a5c-4cb1-91e2-245330ebef44 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:20.980143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4cf27fc8-6a5c-4cb1-91e2-245330ebef44 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:20.989431 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4cf27fc8-6a5c-4cb1-91e2-245330ebef44 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:20.990179 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4cf27fc8-6a5c-4cb1-91e2-245330ebef44 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:20.991389 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4cf27fc8-6a5c-4cb1-91e2-245330ebef44 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:20.992094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4cf27fc8-6a5c-4cb1-91e2-245330ebef44 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:21.177195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9ce1378e-1283-4934-b6f5-8f0005ffc970 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 19342 microversion: 2.1 time: 0.273129 Dec 16 14:46:21.178334 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 420/815] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:20 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 19342 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:21.241647 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4cf27fc8-6a5c-4cb1-91e2-245330ebef44 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:21.251108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4cf27fc8-6a5c-4cb1-91e2-245330ebef44 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.285773 Dec 16 14:46:21.251684 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 396/816] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:20 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:22.213133 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4650173f-137d-4f34-b6d4-1cfae6904254 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:22.215656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4650173f-137d-4f34-b6d4-1cfae6904254 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:22.232091 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4650173f-137d-4f34-b6d4-1cfae6904254 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:22.232859 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4650173f-137d-4f34-b6d4-1cfae6904254 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:22.233891 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4650173f-137d-4f34-b6d4-1cfae6904254 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:22.234673 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4650173f-137d-4f34-b6d4-1cfae6904254 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:22.276020 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7d3a146f-d6bf-4775-96c7-f41e2711d77d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:22.276768 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7d3a146f-d6bf-4775-96c7-f41e2711d77d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:22.287097 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7d3a146f-d6bf-4775-96c7-f41e2711d77d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:22.287544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7d3a146f-d6bf-4775-96c7-f41e2711d77d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:22.288326 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7d3a146f-d6bf-4775-96c7-f41e2711d77d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:22.288774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7d3a146f-d6bf-4775-96c7-f41e2711d77d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:22.401875 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4650173f-137d-4f34-b6d4-1cfae6904254 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 21966 microversion: 2.1 time: 0.213873 Dec 16 14:46:22.403232 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 421/817] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:22 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 21966 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:22.597235 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7d3a146f-d6bf-4775-96c7-f41e2711d77d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:22.607153 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7d3a146f-d6bf-4775-96c7-f41e2711d77d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.341181 Dec 16 14:46:22.608664 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 397/818] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:22 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:22.619603 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-21b3e4a9-c773-4aa9-bb6b-f397801326a2 req-2c355e5a-4f81-471e-9a4b-313d21f89551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd517a0-bd8a-4e52-93ac-304678993d24", "tag": "89eb0392-5a52-4cad-8793-177f104836c0"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:22.626887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:22.626887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:46:22.630538 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ae67c547-3c26-4907-837a-f06cd9e1c451 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:22.632096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ae67c547-3c26-4907-837a-f06cd9e1c451 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:22.637344 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-21b3e4a9-c773-4aa9-bb6b-f397801326a2 req-2c355e5a-4f81-471e-9a4b-313d21f89551 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:22.638222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-21b3e4a9-c773-4aa9-bb6b-f397801326a2 req-2c355e5a-4f81-471e-9a4b-313d21f89551 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:22.642274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ae67c547-3c26-4907-837a-f06cd9e1c451 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:22.642767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ae67c547-3c26-4907-837a-f06cd9e1c451 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:22.643589 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ae67c547-3c26-4907-837a-f06cd9e1c451 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:22.644020 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ae67c547-3c26-4907-837a-f06cd9e1c451 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:22.658464 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-21b3e4a9-c773-4aa9-bb6b-f397801326a2 req-2c355e5a-4f81-471e-9a4b-313d21f89551 service nova] Creating event network-changed:89eb0392-5a52-4cad-8793-177f104836c0 for instance 1bd517a0-bd8a-4e52-93ac-304678993d24 on hv-cinder-82189 Dec 16 14:46:22.664122 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-21b3e4a9-c773-4aa9-bb6b-f397801326a2 req-2c355e5a-4f81-471e-9a4b-313d21f89551 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053874 Dec 16 14:46:22.665350 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 398/819] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:22.782996 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ae67c547-3c26-4907-837a-f06cd9e1c451 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 14 microversion: 2.20 time: 0.175730 Dec 16 14:46:22.784578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 422/820] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:22 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:23.424348 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ed201a67-0dfb-4dd2-b03e-4330976f4283 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:23.425919 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ed201a67-0dfb-4dd2-b03e-4330976f4283 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:23.437453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ed201a67-0dfb-4dd2-b03e-4330976f4283 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:23.438573 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ed201a67-0dfb-4dd2-b03e-4330976f4283 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:23.440091 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ed201a67-0dfb-4dd2-b03e-4330976f4283 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:23.441122 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ed201a67-0dfb-4dd2-b03e-4330976f4283 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:23.643921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c883cfe9-87ac-4c2e-9fec-30e7c77c017a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:23.645949 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c883cfe9-87ac-4c2e-9fec-30e7c77c017a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:23.647970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ed201a67-0dfb-4dd2-b03e-4330976f4283 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 23229 microversion: 2.1 time: 0.235792 Dec 16 14:46:23.649376 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 399/821] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:23 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 23229 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:23.660546 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c883cfe9-87ac-4c2e-9fec-30e7c77c017a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:23.661268 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c883cfe9-87ac-4c2e-9fec-30e7c77c017a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:23.662727 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c883cfe9-87ac-4c2e-9fec-30e7c77c017a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:23.663369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c883cfe9-87ac-4c2e-9fec-30e7c77c017a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:23.815026 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5fea2de2-c9f7-49d2-88e6-1e7d3bc64571 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:23.816238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5fea2de2-c9f7-49d2-88e6-1e7d3bc64571 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:23.824901 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5fea2de2-c9f7-49d2-88e6-1e7d3bc64571 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:23.825340 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5fea2de2-c9f7-49d2-88e6-1e7d3bc64571 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:23.826197 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5fea2de2-c9f7-49d2-88e6-1e7d3bc64571 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:23.826674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5fea2de2-c9f7-49d2-88e6-1e7d3bc64571 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:23.929245 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c883cfe9-87ac-4c2e-9fec-30e7c77c017a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:23.938429 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c883cfe9-87ac-4c2e-9fec-30e7c77c017a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.306753 Dec 16 14:46:23.939002 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 423/822] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:23 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:23.970564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5fea2de2-c9f7-49d2-88e6-1e7d3bc64571 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 14 microversion: 2.20 time: 0.177256 Dec 16 14:46:23.971356 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 400/823] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:23 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:24.665756 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5a8a428f-21f4-4a64-8217-7ddc64b071e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:24.666899 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5a8a428f-21f4-4a64-8217-7ddc64b071e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:24.676198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a8a428f-21f4-4a64-8217-7ddc64b071e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:24.676650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a8a428f-21f4-4a64-8217-7ddc64b071e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:24.677570 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a8a428f-21f4-4a64-8217-7ddc64b071e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:24.678129 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5a8a428f-21f4-4a64-8217-7ddc64b071e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:24.821544 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5a8a428f-21f4-4a64-8217-7ddc64b071e6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 24740 microversion: 2.1 time: 0.165243 Dec 16 14:46:24.822234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 424/824] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:24 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 24740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:24.963207 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0743d57e-070f-4626-ac42-9a8587df5d3f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:24.964010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0743d57e-070f-4626-ac42-9a8587df5d3f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:24.973675 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0743d57e-070f-4626-ac42-9a8587df5d3f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:24.974206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0743d57e-070f-4626-ac42-9a8587df5d3f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:24.975024 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0743d57e-070f-4626-ac42-9a8587df5d3f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:24.975479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0743d57e-070f-4626-ac42-9a8587df5d3f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:25.002379 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-76b8afa1-9330-46e8-bc54-5300a14ae737 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:25.004007 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-76b8afa1-9330-46e8-bc54-5300a14ae737 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:25.014655 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76b8afa1-9330-46e8-bc54-5300a14ae737 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:25.015189 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76b8afa1-9330-46e8-bc54-5300a14ae737 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:25.016095 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76b8afa1-9330-46e8-bc54-5300a14ae737 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:25.016529 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-76b8afa1-9330-46e8-bc54-5300a14ae737 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:25.160027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-76b8afa1-9330-46e8-bc54-5300a14ae737 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 14 microversion: 2.20 time: 0.180448 Dec 16 14:46:25.160890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 425/825] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:24 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:25.223249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-0743d57e-070f-4626-ac42-9a8587df5d3f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:25.232547 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0743d57e-070f-4626-ac42-9a8587df5d3f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.279922 Dec 16 14:46:25.233172 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 401/826] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:24 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:25.843525 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b1505905-1688-4a25-813c-74cd60a0813c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:25.845128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b1505905-1688-4a25-813c-74cd60a0813c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:25.852202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b1505905-1688-4a25-813c-74cd60a0813c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:25.852643 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b1505905-1688-4a25-813c-74cd60a0813c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:25.853424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b1505905-1688-4a25-813c-74cd60a0813c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:25.853842 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b1505905-1688-4a25-813c-74cd60a0813c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:26.005829 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b1505905-1688-4a25-813c-74cd60a0813c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 26179 microversion: 2.1 time: 0.172565 Dec 16 14:46:26.006518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 426/827] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:25 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 26179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:26.189512 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-369a6412-abbd-45ce-a539-4c02025b82e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:26.191256 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-369a6412-abbd-45ce-a539-4c02025b82e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:26.207567 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-369a6412-abbd-45ce-a539-4c02025b82e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:26.208365 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-369a6412-abbd-45ce-a539-4c02025b82e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:26.209808 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-369a6412-abbd-45ce-a539-4c02025b82e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:26.210596 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-369a6412-abbd-45ce-a539-4c02025b82e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:26.257391 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7edf5b82-40d5-4c08-a4e0-c34e2a8e4b95 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:26.258251 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7edf5b82-40d5-4c08-a4e0-c34e2a8e4b95 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:26.268073 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7edf5b82-40d5-4c08-a4e0-c34e2a8e4b95 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:26.268073 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7edf5b82-40d5-4c08-a4e0-c34e2a8e4b95 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:26.268702 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7edf5b82-40d5-4c08-a4e0-c34e2a8e4b95 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:26.269257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7edf5b82-40d5-4c08-a4e0-c34e2a8e4b95 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:26.402385 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-369a6412-abbd-45ce-a539-4c02025b82e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 14 microversion: 2.20 time: 0.233810 Dec 16 14:46:26.403268 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 402/828] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:26 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:26.658437 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7edf5b82-40d5-4c08-a4e0-c34e2a8e4b95 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:26.671149 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7edf5b82-40d5-4c08-a4e0-c34e2a8e4b95 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.422785 Dec 16 14:46:26.671149 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 427/829] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:26 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:27.030188 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f4cff687-fdec-449b-b9bf-8b459b32eab7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:27.031245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f4cff687-fdec-449b-b9bf-8b459b32eab7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:27.040427 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f4cff687-fdec-449b-b9bf-8b459b32eab7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:27.040879 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f4cff687-fdec-449b-b9bf-8b459b32eab7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:27.041679 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f4cff687-fdec-449b-b9bf-8b459b32eab7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:27.042145 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f4cff687-fdec-449b-b9bf-8b459b32eab7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:27.202971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f4cff687-fdec-449b-b9bf-8b459b32eab7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 27419 microversion: 2.1 time: 0.187174 Dec 16 14:46:27.204232 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 403/830] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:27 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 27419 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:27.419510 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8a68cf9a-94a5-438c-a4c4-f0e9b456e61a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:27.420630 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8a68cf9a-94a5-438c-a4c4-f0e9b456e61a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:27.430693 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8a68cf9a-94a5-438c-a4c4-f0e9b456e61a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:27.431083 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8a68cf9a-94a5-438c-a4c4-f0e9b456e61a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:27.431929 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8a68cf9a-94a5-438c-a4c4-f0e9b456e61a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:27.432701 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8a68cf9a-94a5-438c-a4c4-f0e9b456e61a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:27.591826 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8a68cf9a-94a5-438c-a4c4-f0e9b456e61a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 14 microversion: 2.20 time: 0.182206 Dec 16 14:46:27.595181 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 428/831] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:27 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:27.699013 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-085bcfe7-92b1-4b6d-88d7-a3a2557a34e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:27.700185 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-085bcfe7-92b1-4b6d-88d7-a3a2557a34e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:27.710839 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-085bcfe7-92b1-4b6d-88d7-a3a2557a34e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:27.711854 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-085bcfe7-92b1-4b6d-88d7-a3a2557a34e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:27.712776 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-085bcfe7-92b1-4b6d-88d7-a3a2557a34e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:27.713224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-085bcfe7-92b1-4b6d-88d7-a3a2557a34e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:27.952252 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-085bcfe7-92b1-4b6d-88d7-a3a2557a34e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:27.961793 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-085bcfe7-92b1-4b6d-88d7-a3a2557a34e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.276311 Dec 16 14:46:27.963010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 404/832] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:27 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:28.222183 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f5d4411e-9f6c-4503-a9dc-75cf87d67cc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:28.223207 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f5d4411e-9f6c-4503-a9dc-75cf87d67cc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:28.234503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f5d4411e-9f6c-4503-a9dc-75cf87d67cc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:28.234971 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f5d4411e-9f6c-4503-a9dc-75cf87d67cc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:28.235739 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f5d4411e-9f6c-4503-a9dc-75cf87d67cc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:28.236163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f5d4411e-9f6c-4503-a9dc-75cf87d67cc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:28.384661 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f5d4411e-9f6c-4503-a9dc-75cf87d67cc5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 27819 microversion: 2.1 time: 0.172350 Dec 16 14:46:28.385348 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 429/833] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:28 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 27819 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:28.613287 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3e6bcfe3-6f86-467b-b2df-5b75e6f17957 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:28.614269 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3e6bcfe3-6f86-467b-b2df-5b75e6f17957 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:28.622481 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3e6bcfe3-6f86-467b-b2df-5b75e6f17957 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:28.622932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3e6bcfe3-6f86-467b-b2df-5b75e6f17957 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:28.623764 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3e6bcfe3-6f86-467b-b2df-5b75e6f17957 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:28.624804 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3e6bcfe3-6f86-467b-b2df-5b75e6f17957 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:28.793415 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3e6bcfe3-6f86-467b-b2df-5b75e6f17957 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 14 microversion: 2.20 time: 0.193379 Dec 16 14:46:28.794265 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 405/834] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:28 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:28.988529 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5c62c2dd-384a-46b3-a299-b37398015c45 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:28.989395 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5c62c2dd-384a-46b3-a299-b37398015c45 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:28.999992 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5c62c2dd-384a-46b3-a299-b37398015c45 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:29.000795 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5c62c2dd-384a-46b3-a299-b37398015c45 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:29.002096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5c62c2dd-384a-46b3-a299-b37398015c45 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:29.002810 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5c62c2dd-384a-46b3-a299-b37398015c45 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:29.301847 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5c62c2dd-384a-46b3-a299-b37398015c45 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:29.312257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5c62c2dd-384a-46b3-a299-b37398015c45 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.334535 Dec 16 14:46:29.312832 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 430/835] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:28 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:29.403931 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-61984c39-4fce-452c-90ff-9701bc28d5ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:29.404973 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-61984c39-4fce-452c-90ff-9701bc28d5ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:29.413909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-61984c39-4fce-452c-90ff-9701bc28d5ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:29.414392 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-61984c39-4fce-452c-90ff-9701bc28d5ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:29.415198 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-61984c39-4fce-452c-90ff-9701bc28d5ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:29.415627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-61984c39-4fce-452c-90ff-9701bc28d5ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:29.556905 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-61984c39-4fce-452c-90ff-9701bc28d5ac tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.163045 Dec 16 14:46:29.557947 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 406/836] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:29 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:29.812688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-74cd06ac-3989-43c4-9f0d-ca96fe425733 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:29.813718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-74cd06ac-3989-43c4-9f0d-ca96fe425733 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:29.827593 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-74cd06ac-3989-43c4-9f0d-ca96fe425733 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:29.828076 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-74cd06ac-3989-43c4-9f0d-ca96fe425733 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:29.828918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-74cd06ac-3989-43c4-9f0d-ca96fe425733 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:29.829413 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-74cd06ac-3989-43c4-9f0d-ca96fe425733 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:29.970294 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-74cd06ac-3989-43c4-9f0d-ca96fe425733 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 14 microversion: 2.20 time: 0.167192 Dec 16 14:46:29.970924 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 431/837] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:29 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:30.336214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-091660ee-dc7b-4bd6-b4ed-7fe177590749 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:30.336975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-091660ee-dc7b-4bd6-b4ed-7fe177590749 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:30.345853 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-091660ee-dc7b-4bd6-b4ed-7fe177590749 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:30.346333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-091660ee-dc7b-4bd6-b4ed-7fe177590749 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:30.347114 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-091660ee-dc7b-4bd6-b4ed-7fe177590749 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:30.347530 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-091660ee-dc7b-4bd6-b4ed-7fe177590749 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:30.573607 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-091660ee-dc7b-4bd6-b4ed-7fe177590749 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:30.577129 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-36b796a7-ca19-4e73-905a-eab5c1aedca0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:30.578302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-36b796a7-ca19-4e73-905a-eab5c1aedca0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:30.585772 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-091660ee-dc7b-4bd6-b4ed-7fe177590749 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.259794 Dec 16 14:46:30.586657 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 407/838] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:30 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:30.593567 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-36b796a7-ca19-4e73-905a-eab5c1aedca0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:30.594156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-36b796a7-ca19-4e73-905a-eab5c1aedca0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:30.594968 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-36b796a7-ca19-4e73-905a-eab5c1aedca0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:30.595592 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-36b796a7-ca19-4e73-905a-eab5c1aedca0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:30.738856 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-36b796a7-ca19-4e73-905a-eab5c1aedca0 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.171432 Dec 16 14:46:30.739521 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 432/839] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:30 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:30.989314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f33f8550-caab-435c-b518-90ee126c6bc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:30.990569 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f33f8550-caab-435c-b518-90ee126c6bc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:30.999671 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f33f8550-caab-435c-b518-90ee126c6bc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:31.000396 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f33f8550-caab-435c-b518-90ee126c6bc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:31.001772 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f33f8550-caab-435c-b518-90ee126c6bc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:31.002548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f33f8550-caab-435c-b518-90ee126c6bc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:31.169539 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f33f8550-caab-435c-b518-90ee126c6bc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 14 microversion: 2.20 time: 0.191134 Dec 16 14:46:31.170486 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 408/840] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:30 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:31.610458 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-aa54a261-0416-4b96-9ae4-e2289518485d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:31.611255 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-aa54a261-0416-4b96-9ae4-e2289518485d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:31.620054 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-aa54a261-0416-4b96-9ae4-e2289518485d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:31.620498 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-aa54a261-0416-4b96-9ae4-e2289518485d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:31.621321 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-aa54a261-0416-4b96-9ae4-e2289518485d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:31.621773 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-aa54a261-0416-4b96-9ae4-e2289518485d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:31.760683 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9dc85f07-2fcc-4d5b-97b4-146dce667cb6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:31.761724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9dc85f07-2fcc-4d5b-97b4-146dce667cb6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:31.770572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9dc85f07-2fcc-4d5b-97b4-146dce667cb6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:31.771015 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9dc85f07-2fcc-4d5b-97b4-146dce667cb6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:31.772033 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9dc85f07-2fcc-4d5b-97b4-146dce667cb6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:31.772238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9dc85f07-2fcc-4d5b-97b4-146dce667cb6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:31.854156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-aa54a261-0416-4b96-9ae4-e2289518485d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:31.867216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-aa54a261-0416-4b96-9ae4-e2289518485d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.266921 Dec 16 14:46:31.868229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 433/841] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:31 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:31.915955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9dc85f07-2fcc-4d5b-97b4-146dce667cb6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.168221 Dec 16 14:46:31.916601 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 409/842] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:31 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:32.188522 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4f568e14-bdb7-4ebe-9f2c-277a782baaf7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:32.189497 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4f568e14-bdb7-4ebe-9f2c-277a782baaf7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:32.197426 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4f568e14-bdb7-4ebe-9f2c-277a782baaf7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:32.197899 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4f568e14-bdb7-4ebe-9f2c-277a782baaf7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:32.198707 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4f568e14-bdb7-4ebe-9f2c-277a782baaf7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:32.199138 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4f568e14-bdb7-4ebe-9f2c-277a782baaf7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:32.344898 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4f568e14-bdb7-4ebe-9f2c-277a782baaf7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 3829 microversion: 2.20 time: 0.167038 Dec 16 14:46:32.345541 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 434/843] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:32 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 3829 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:32.912817 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8f1cffc0-8c36-48bb-97e0-20779d34591b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:32.914260 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8f1cffc0-8c36-48bb-97e0-20779d34591b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:32.929419 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8f1cffc0-8c36-48bb-97e0-20779d34591b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:32.930520 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8f1cffc0-8c36-48bb-97e0-20779d34591b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:32.931972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8f1cffc0-8c36-48bb-97e0-20779d34591b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:32.932759 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8f1cffc0-8c36-48bb-97e0-20779d34591b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:32.942886 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-79e886cf-efdb-4b69-829b-df9e9c134cdc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:32.944689 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-79e886cf-efdb-4b69-829b-df9e9c134cdc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:32.960015 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-79e886cf-efdb-4b69-829b-df9e9c134cdc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:32.961036 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-79e886cf-efdb-4b69-829b-df9e9c134cdc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:32.962456 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-79e886cf-efdb-4b69-829b-df9e9c134cdc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:32.963268 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-79e886cf-efdb-4b69-829b-df9e9c134cdc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:33.176517 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-79e886cf-efdb-4b69-829b-df9e9c134cdc tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.251252 Dec 16 14:46:33.178028 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 435/844] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:32 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:33.328024 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8f1cffc0-8c36-48bb-97e0-20779d34591b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:33.338569 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8f1cffc0-8c36-48bb-97e0-20779d34591b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.446792 Dec 16 14:46:33.339466 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 410/845] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:32 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:33.365916 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b86d5416-0729-4ad6-8625-6f723a0808bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:33.367079 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b86d5416-0729-4ad6-8625-6f723a0808bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:33.377697 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b86d5416-0729-4ad6-8625-6f723a0808bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:33.378566 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b86d5416-0729-4ad6-8625-6f723a0808bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:33.380644 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b86d5416-0729-4ad6-8625-6f723a0808bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:33.381438 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b86d5416-0729-4ad6-8625-6f723a0808bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:33.579376 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b86d5416-0729-4ad6-8625-6f723a0808bb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 15025 microversion: 2.20 time: 0.225457 Dec 16 14:46:33.580471 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 436/846] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:33 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 15025 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:34.196774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3ed97611-c8d5-465c-b5a2-d9feb2ca2c6b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:34.197690 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3ed97611-c8d5-465c-b5a2-d9feb2ca2c6b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:34.208102 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3ed97611-c8d5-465c-b5a2-d9feb2ca2c6b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:34.208546 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3ed97611-c8d5-465c-b5a2-d9feb2ca2c6b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:34.209323 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3ed97611-c8d5-465c-b5a2-d9feb2ca2c6b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:34.209756 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3ed97611-c8d5-465c-b5a2-d9feb2ca2c6b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:34.360041 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3ed97611-c8d5-465c-b5a2-d9feb2ca2c6b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.172287 Dec 16 14:46:34.360687 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 411/847] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:34 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:34.366919 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7375feea-46d9-44ca-abd6-f83e7698862d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:34.367628 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7375feea-46d9-44ca-abd6-f83e7698862d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:34.376464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7375feea-46d9-44ca-abd6-f83e7698862d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:34.376921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7375feea-46d9-44ca-abd6-f83e7698862d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:34.377719 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7375feea-46d9-44ca-abd6-f83e7698862d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:34.378185 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7375feea-46d9-44ca-abd6-f83e7698862d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:34.599812 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f79c1aca-7b9f-4d35-9dd0-bdcb1434eefa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:34.601173 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f79c1aca-7b9f-4d35-9dd0-bdcb1434eefa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:34.609625 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f79c1aca-7b9f-4d35-9dd0-bdcb1434eefa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:34.610247 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f79c1aca-7b9f-4d35-9dd0-bdcb1434eefa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:34.611042 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f79c1aca-7b9f-4d35-9dd0-bdcb1434eefa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:34.611462 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f79c1aca-7b9f-4d35-9dd0-bdcb1434eefa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:34.628782 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7375feea-46d9-44ca-abd6-f83e7698862d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:34.638847 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7375feea-46d9-44ca-abd6-f83e7698862d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.281961 Dec 16 14:46:34.639660 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 437/848] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:34 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:34.907543 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f79c1aca-7b9f-4d35-9dd0-bdcb1434eefa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 18208 microversion: 2.20 time: 0.317628 Dec 16 14:46:34.908364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 412/849] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:34 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 18208 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:46:35.380596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ff3d6777-2860-4b65-87ee-07a7c3363a5d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:35.381547 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ff3d6777-2860-4b65-87ee-07a7c3363a5d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:35.391741 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ff3d6777-2860-4b65-87ee-07a7c3363a5d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:35.392176 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ff3d6777-2860-4b65-87ee-07a7c3363a5d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:35.392962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ff3d6777-2860-4b65-87ee-07a7c3363a5d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:35.393387 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ff3d6777-2860-4b65-87ee-07a7c3363a5d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:35.536943 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ff3d6777-2860-4b65-87ee-07a7c3363a5d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.166979 Dec 16 14:46:35.537559 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 438/850] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:35 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:35.663638 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-376dacf2-be21-40b7-ac2a-4bcf88984d2c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:35.664314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-376dacf2-be21-40b7-ac2a-4bcf88984d2c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:35.673785 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-376dacf2-be21-40b7-ac2a-4bcf88984d2c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:35.674397 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-376dacf2-be21-40b7-ac2a-4bcf88984d2c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:35.675226 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-376dacf2-be21-40b7-ac2a-4bcf88984d2c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:35.675690 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-376dacf2-be21-40b7-ac2a-4bcf88984d2c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:35.927149 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2cc5792e-5652-4fd7-ae19-e4609603c7b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:35.928181 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2cc5792e-5652-4fd7-ae19-e4609603c7b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:35.932801 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-376dacf2-be21-40b7-ac2a-4bcf88984d2c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:35.937303 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2cc5792e-5652-4fd7-ae19-e4609603c7b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:35.937753 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2cc5792e-5652-4fd7-ae19-e4609603c7b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:35.938606 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2cc5792e-5652-4fd7-ae19-e4609603c7b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:35.939080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2cc5792e-5652-4fd7-ae19-e4609603c7b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:35.945592 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-376dacf2-be21-40b7-ac2a-4bcf88984d2c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.291291 Dec 16 14:46:35.946173 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 413/851] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:35 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:36.080078 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2cc5792e-5652-4fd7-ae19-e4609603c7b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 19342 microversion: 2.20 time: 0.163123 Dec 16 14:46:36.080971 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 439/852] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:35 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 19342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:46:36.557203 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a966e316-64b1-4f13-8e59-aa6ca6aaf8bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:36.558431 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a966e316-64b1-4f13-8e59-aa6ca6aaf8bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:36.566364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a966e316-64b1-4f13-8e59-aa6ca6aaf8bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:36.566804 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a966e316-64b1-4f13-8e59-aa6ca6aaf8bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:36.567580 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a966e316-64b1-4f13-8e59-aa6ca6aaf8bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:36.567997 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a966e316-64b1-4f13-8e59-aa6ca6aaf8bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:36.718333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a966e316-64b1-4f13-8e59-aa6ca6aaf8bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.171872 Dec 16 14:46:36.719386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 414/853] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:36 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:36.973654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7cc78e95-0869-447d-950e-8dac5fc8ac4a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:36.974686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7cc78e95-0869-447d-950e-8dac5fc8ac4a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:36.986080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7cc78e95-0869-447d-950e-8dac5fc8ac4a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:36.986532 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7cc78e95-0869-447d-950e-8dac5fc8ac4a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:36.987340 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7cc78e95-0869-447d-950e-8dac5fc8ac4a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:36.987776 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7cc78e95-0869-447d-950e-8dac5fc8ac4a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.111163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-63980763-9926-4a28-b360-8a1d6f0180c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:37.117689 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-63980763-9926-4a28-b360-8a1d6f0180c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:37.135405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63980763-9926-4a28-b360-8a1d6f0180c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.137619 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63980763-9926-4a28-b360-8a1d6f0180c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.138210 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63980763-9926-4a28-b360-8a1d6f0180c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.139393 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63980763-9926-4a28-b360-8a1d6f0180c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.295227 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7cc78e95-0869-447d-950e-8dac5fc8ac4a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:37.304579 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7cc78e95-0869-447d-950e-8dac5fc8ac4a tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1507 microversion: 2.1 time: 0.344187 Dec 16 14:46:37.305148 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 440/854] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:36 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:37.314491 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-63980763-9926-4a28-b360-8a1d6f0180c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 22494 microversion: 2.20 time: 0.223553 Dec 16 14:46:37.315678 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 415/855] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:37 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 22494 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:46:37.327431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0ff1b121-e16d-4ed6-bfb1-23091e6e7c2f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:37.328214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0ff1b121-e16d-4ed6-bfb1-23091e6e7c2f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:37.336799 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ff1b121-e16d-4ed6-bfb1-23091e6e7c2f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.337253 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ff1b121-e16d-4ed6-bfb1-23091e6e7c2f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.338123 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ff1b121-e16d-4ed6-bfb1-23091e6e7c2f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.338552 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0ff1b121-e16d-4ed6-bfb1-23091e6e7c2f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.632762 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0ff1b121-e16d-4ed6-bfb1-23091e6e7c2f tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "POST /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20/action" status: 202 len: 0 microversion: 2.1 time: 0.314565 Dec 16 14:46:37.633508 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 441/856] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:37 2021] POST /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:46:37.661407 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ef5e2484-2bf7-4d85-9d18-67643eb7ec40 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:37.663440 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ef5e2484-2bf7-4d85-9d18-67643eb7ec40 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:37.682354 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef5e2484-2bf7-4d85-9d18-67643eb7ec40 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.683156 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef5e2484-2bf7-4d85-9d18-67643eb7ec40 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.684709 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef5e2484-2bf7-4d85-9d18-67643eb7ec40 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.685790 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef5e2484-2bf7-4d85-9d18-67643eb7ec40 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.743116 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2012d9db-7113-4bea-88ef-3fbc0e4bf222 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:37.744432 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2012d9db-7113-4bea-88ef-3fbc0e4bf222 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:37.754867 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2012d9db-7113-4bea-88ef-3fbc0e4bf222 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.756212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2012d9db-7113-4bea-88ef-3fbc0e4bf222 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.757377 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2012d9db-7113-4bea-88ef-3fbc0e4bf222 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.757966 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2012d9db-7113-4bea-88ef-3fbc0e4bf222 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.922322 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2012d9db-7113-4bea-88ef-3fbc0e4bf222 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.193365 Dec 16 14:46:37.924419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 442/857] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:37 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:38.008367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ef5e2484-2bf7-4d85-9d18-67643eb7ec40 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:38.017717 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ef5e2484-2bf7-4d85-9d18-67643eb7ec40 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1515 microversion: 2.1 time: 0.377656 Dec 16 14:46:38.018325 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 416/858] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:37 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1515 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:38.299811 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-a4e90331-4791-475b-9a42-ff80261654d5 req-8e9ab547-7f31-4124-b7d7-9afbd9729792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6e43c8-eea5-48d0-b7bf-ff18381a0f20", "name": "network-vif-unplugged", "status": "completed", "tag": "a1de2547-6459-4d87-9d1f-a9adfc216809"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:38.314681 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:38.314681 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:46:38.335444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-a4e90331-4791-475b-9a42-ff80261654d5 req-8e9ab547-7f31-4124-b7d7-9afbd9729792 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:38.336138 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-a4e90331-4791-475b-9a42-ff80261654d5 req-8e9ab547-7f31-4124-b7d7-9afbd9729792 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:38.339876 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9c31505b-05ec-4160-ad63-a4cd4930e870 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:38.341575 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9c31505b-05ec-4160-ad63-a4cd4930e870 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:38.357522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9c31505b-05ec-4160-ad63-a4cd4930e870 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:38.358619 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9c31505b-05ec-4160-ad63-a4cd4930e870 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:38.360691 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9c31505b-05ec-4160-ad63-a4cd4930e870 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:38.362360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9c31505b-05ec-4160-ad63-a4cd4930e870 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:38.370503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.compute.server_external_events [req-a4e90331-4791-475b-9a42-ff80261654d5 req-8e9ab547-7f31-4124-b7d7-9afbd9729792 service nova] Unable to find a host for instance fd6e43c8-eea5-48d0-b7bf-ff18381a0f20. Dropping event network-vif-unplugged {{(pid=96670) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 16 14:46:38.371565 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-a4e90331-4791-475b-9a42-ff80261654d5 req-8e9ab547-7f31-4124-b7d7-9afbd9729792 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.093600 Dec 16 14:46:38.373003 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 443/859] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 97 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 16 14:46:38.551126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9c31505b-05ec-4160-ad63-a4cd4930e870 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 23804 microversion: 2.20 time: 0.225024 Dec 16 14:46:38.551861 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 417/860] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:38 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 23804 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:38.942921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3aba9313-d6fb-4e0c-a569-aba6fd9b4bca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:38.943855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3aba9313-d6fb-4e0c-a569-aba6fd9b4bca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:38.951822 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3aba9313-d6fb-4e0c-a569-aba6fd9b4bca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:38.952282 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3aba9313-d6fb-4e0c-a569-aba6fd9b4bca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:38.953053 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3aba9313-d6fb-4e0c-a569-aba6fd9b4bca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:38.953496 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3aba9313-d6fb-4e0c-a569-aba6fd9b4bca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:39.051900 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4e678472-ff57-4f82-b59f-52602aaa1c4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:39.052803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4e678472-ff57-4f82-b59f-52602aaa1c4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:39.061958 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4e678472-ff57-4f82-b59f-52602aaa1c4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:39.063094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4e678472-ff57-4f82-b59f-52602aaa1c4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:39.064062 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4e678472-ff57-4f82-b59f-52602aaa1c4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:39.064593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4e678472-ff57-4f82-b59f-52602aaa1c4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:39.112696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3aba9313-d6fb-4e0c-a569-aba6fd9b4bca tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.179217 Dec 16 14:46:39.115626 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 444/861] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:38 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:39.336729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4e678472-ff57-4f82-b59f-52602aaa1c4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:39.347287 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4e678472-ff57-4f82-b59f-52602aaa1c4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1517 microversion: 2.1 time: 0.306919 Dec 16 14:46:39.347842 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 418/862] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:39 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1517 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:39.570873 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-93d90a3e-40fb-4292-9696-7e5008005a94 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:39.571901 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-93d90a3e-40fb-4292-9696-7e5008005a94 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:39.580956 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-93d90a3e-40fb-4292-9696-7e5008005a94 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:39.581402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-93d90a3e-40fb-4292-9696-7e5008005a94 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:39.582250 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-93d90a3e-40fb-4292-9696-7e5008005a94 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:39.582692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-93d90a3e-40fb-4292-9696-7e5008005a94 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:39.747352 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-93d90a3e-40fb-4292-9696-7e5008005a94 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 25482 microversion: 2.20 time: 0.186707 Dec 16 14:46:39.748009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 445/863] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:39 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 25482 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:40.132136 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-75c1d814-03d1-4dad-b26c-aed5a0203c4b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:40.133085 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-75c1d814-03d1-4dad-b26c-aed5a0203c4b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:40.142304 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-75c1d814-03d1-4dad-b26c-aed5a0203c4b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.142908 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-75c1d814-03d1-4dad-b26c-aed5a0203c4b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.143751 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-75c1d814-03d1-4dad-b26c-aed5a0203c4b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.144232 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-75c1d814-03d1-4dad-b26c-aed5a0203c4b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.272526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-75c1d814-03d1-4dad-b26c-aed5a0203c4b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.150118 Dec 16 14:46:40.273186 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 419/864] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:40 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:40.371381 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fef51a40-2c8d-4e4f-badc-51e373f48bbe tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:40.372090 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fef51a40-2c8d-4e4f-badc-51e373f48bbe tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:40.380840 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fef51a40-2c8d-4e4f-badc-51e373f48bbe tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.381297 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fef51a40-2c8d-4e4f-badc-51e373f48bbe tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.382132 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fef51a40-2c8d-4e4f-badc-51e373f48bbe tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.382632 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fef51a40-2c8d-4e4f-badc-51e373f48bbe tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.726031 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-fef51a40-2c8d-4e4f-badc-51e373f48bbe tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:40.737337 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fef51a40-2c8d-4e4f-badc-51e373f48bbe tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1517 microversion: 2.1 time: 0.375966 Dec 16 14:46:40.738265 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 446/865] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:40 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1517 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:40.778856 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9d2aef47-e170-4f03-839d-0ea1bb90b43f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:40.780848 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9d2aef47-e170-4f03-839d-0ea1bb90b43f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:40.796391 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9d2aef47-e170-4f03-839d-0ea1bb90b43f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.797319 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9d2aef47-e170-4f03-839d-0ea1bb90b43f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.798846 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9d2aef47-e170-4f03-839d-0ea1bb90b43f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.799627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9d2aef47-e170-4f03-839d-0ea1bb90b43f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.984157 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9d2aef47-e170-4f03-839d-0ea1bb90b43f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 26993 microversion: 2.20 time: 0.226222 Dec 16 14:46:40.984787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 420/866] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:40 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 26993 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:41.290979 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-efee77b1-d21f-4413-871e-17fe6e228894 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:41.291800 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-efee77b1-d21f-4413-871e-17fe6e228894 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:41.300442 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-efee77b1-d21f-4413-871e-17fe6e228894 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:41.300897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-efee77b1-d21f-4413-871e-17fe6e228894 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:41.301679 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-efee77b1-d21f-4413-871e-17fe6e228894 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:41.302143 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-efee77b1-d21f-4413-871e-17fe6e228894 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:41.762824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-efee77b1-d21f-4413-871e-17fe6e228894 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.481640 Dec 16 14:46:41.763558 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 447/867] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:41 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:41.764437 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2e18dbac-9bb6-4b5b-8593-09d03d6db9af tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:41.765150 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2e18dbac-9bb6-4b5b-8593-09d03d6db9af tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:41.774658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2e18dbac-9bb6-4b5b-8593-09d03d6db9af tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:41.775091 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2e18dbac-9bb6-4b5b-8593-09d03d6db9af tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:41.775870 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2e18dbac-9bb6-4b5b-8593-09d03d6db9af tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:41.776292 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2e18dbac-9bb6-4b5b-8593-09d03d6db9af tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:41.999375 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2e18dbac-9bb6-4b5b-8593-09d03d6db9af tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:42.004196 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b392b1c5-dadc-4933-abbf-d2839b6dfe86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:42.005243 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b392b1c5-dadc-4933-abbf-d2839b6dfe86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:42.009802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2e18dbac-9bb6-4b5b-8593-09d03d6db9af tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.256865 Dec 16 14:46:42.010555 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 421/868] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:41 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:42.014032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b392b1c5-dadc-4933-abbf-d2839b6dfe86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:42.014421 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b392b1c5-dadc-4933-abbf-d2839b6dfe86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:42.015197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b392b1c5-dadc-4933-abbf-d2839b6dfe86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:42.015802 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b392b1c5-dadc-4933-abbf-d2839b6dfe86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:42.163842 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b392b1c5-dadc-4933-abbf-d2839b6dfe86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 27678 microversion: 2.20 time: 0.170416 Dec 16 14:46:42.164306 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 448/869] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:41 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 27678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:42.781798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ac3b3a7b-9af9-4091-8aae-9b75fb9e661e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:42.782741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ac3b3a7b-9af9-4091-8aae-9b75fb9e661e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:42.792872 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac3b3a7b-9af9-4091-8aae-9b75fb9e661e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:42.792872 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac3b3a7b-9af9-4091-8aae-9b75fb9e661e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:42.793390 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac3b3a7b-9af9-4091-8aae-9b75fb9e661e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:42.793860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac3b3a7b-9af9-4091-8aae-9b75fb9e661e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:42.939878 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ac3b3a7b-9af9-4091-8aae-9b75fb9e661e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.167891 Dec 16 14:46:42.940531 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 422/870] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:42 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:43.033524 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-571e9735-147b-45d4-b41a-361a576922cc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:43.034263 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-571e9735-147b-45d4-b41a-361a576922cc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:43.042569 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-571e9735-147b-45d4-b41a-361a576922cc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.043004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-571e9735-147b-45d4-b41a-361a576922cc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:43.043782 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-571e9735-147b-45d4-b41a-361a576922cc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.044199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-571e9735-147b-45d4-b41a-361a576922cc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:43.182080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-81739086-68c8-4201-9a22-c137a6293bf3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:43.183134 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-81739086-68c8-4201-9a22-c137a6293bf3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:43.191312 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-81739086-68c8-4201-9a22-c137a6293bf3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.192192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-81739086-68c8-4201-9a22-c137a6293bf3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:43.192554 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-81739086-68c8-4201-9a22-c137a6293bf3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.192985 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-81739086-68c8-4201-9a22-c137a6293bf3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:43.276726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-571e9735-147b-45d4-b41a-361a576922cc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:43.286697 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-571e9735-147b-45d4-b41a-361a576922cc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.263089 Dec 16 14:46:43.287177 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 449/871] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:43 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:43.339316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-81739086-68c8-4201-9a22-c137a6293bf3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28107 microversion: 2.20 time: 0.167011 Dec 16 14:46:43.339999 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 423/872] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:43 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28107 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:46:43.958373 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-991885a4-0bcf-4d3e-b30e-9c29b19d328a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:43.959297 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-991885a4-0bcf-4d3e-b30e-9c29b19d328a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:43.967235 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-991885a4-0bcf-4d3e-b30e-9c29b19d328a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.967685 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-991885a4-0bcf-4d3e-b30e-9c29b19d328a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:43.968728 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-991885a4-0bcf-4d3e-b30e-9c29b19d328a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.969162 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-991885a4-0bcf-4d3e-b30e-9c29b19d328a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:44.114876 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-991885a4-0bcf-4d3e-b30e-9c29b19d328a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28185 microversion: 2.1 time: 0.166474 Dec 16 14:46:44.116191 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 450/873] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:43 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:44.310408 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f16c999f-8143-4b09-aaf1-2d1757afcce2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:44.311316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f16c999f-8143-4b09-aaf1-2d1757afcce2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:44.320022 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f16c999f-8143-4b09-aaf1-2d1757afcce2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:44.320468 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f16c999f-8143-4b09-aaf1-2d1757afcce2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:44.321245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f16c999f-8143-4b09-aaf1-2d1757afcce2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:44.321666 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f16c999f-8143-4b09-aaf1-2d1757afcce2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:44.358865 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-63cbe22d-b408-4dd2-8722-6ab0e69bcfa6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:44.360035 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-63cbe22d-b408-4dd2-8722-6ab0e69bcfa6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:44.368289 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-63cbe22d-b408-4dd2-8722-6ab0e69bcfa6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:44.368744 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-63cbe22d-b408-4dd2-8722-6ab0e69bcfa6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:44.369530 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-63cbe22d-b408-4dd2-8722-6ab0e69bcfa6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:44.369958 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-63cbe22d-b408-4dd2-8722-6ab0e69bcfa6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:44.521248 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-63cbe22d-b408-4dd2-8722-6ab0e69bcfa6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.172501 Dec 16 14:46:44.522940 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 451/874] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:44 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:46:44.556679 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f16c999f-8143-4b09-aaf1-2d1757afcce2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:44.566296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f16c999f-8143-4b09-aaf1-2d1757afcce2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.265866 Dec 16 14:46:44.567053 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 424/875] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:44 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:45.136751 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-72227e7c-e82c-4ef7-9165-cd554b37c10e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:45.138327 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-72227e7c-e82c-4ef7-9165-cd554b37c10e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:45.148192 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-72227e7c-e82c-4ef7-9165-cd554b37c10e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:45.148645 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-72227e7c-e82c-4ef7-9165-cd554b37c10e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:45.149438 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-72227e7c-e82c-4ef7-9165-cd554b37c10e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:45.149864 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-72227e7c-e82c-4ef7-9165-cd554b37c10e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:45.292082 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-72227e7c-e82c-4ef7-9165-cd554b37c10e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28476 microversion: 2.1 time: 0.166871 Dec 16 14:46:45.293115 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 452/876] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:45 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:45.542299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-877c12ec-bff1-44a2-a5f3-f151580cdca4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:45.543276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-877c12ec-bff1-44a2-a5f3-f151580cdca4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:45.553480 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-877c12ec-bff1-44a2-a5f3-f151580cdca4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:45.553977 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-877c12ec-bff1-44a2-a5f3-f151580cdca4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:45.554849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-877c12ec-bff1-44a2-a5f3-f151580cdca4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:45.555295 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-877c12ec-bff1-44a2-a5f3-f151580cdca4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:45.595303 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fe61dfcd-48b9-4443-a1b7-35c0612be66c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:45.596615 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fe61dfcd-48b9-4443-a1b7-35c0612be66c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:45.611473 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe61dfcd-48b9-4443-a1b7-35c0612be66c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:45.612139 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe61dfcd-48b9-4443-a1b7-35c0612be66c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:45.613169 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe61dfcd-48b9-4443-a1b7-35c0612be66c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:45.613705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe61dfcd-48b9-4443-a1b7-35c0612be66c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:45.719179 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-877c12ec-bff1-44a2-a5f3-f151580cdca4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.186584 Dec 16 14:46:45.719991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 425/877] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:45 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:45.915096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-fe61dfcd-48b9-4443-a1b7-35c0612be66c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:45.924068 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fe61dfcd-48b9-4443-a1b7-35c0612be66c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.343486 Dec 16 14:46:45.924626 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 453/878] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:45 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:46.310504 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-444c4a86-c70f-47e3-9d63-94057706736d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:46.311520 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-444c4a86-c70f-47e3-9d63-94057706736d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:46.320138 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-444c4a86-c70f-47e3-9d63-94057706736d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:46.320583 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-444c4a86-c70f-47e3-9d63-94057706736d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:46.321350 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-444c4a86-c70f-47e3-9d63-94057706736d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:46.321796 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-444c4a86-c70f-47e3-9d63-94057706736d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:46.458299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-444c4a86-c70f-47e3-9d63-94057706736d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28476 microversion: 2.1 time: 0.157162 Dec 16 14:46:46.458884 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 426/879] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:46 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:46.739003 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-390deeb3-e089-45e5-aa22-48ff61313d92 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:46.739839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-390deeb3-e089-45e5-aa22-48ff61313d92 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:46.749274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-390deeb3-e089-45e5-aa22-48ff61313d92 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:46.749725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-390deeb3-e089-45e5-aa22-48ff61313d92 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:46.750552 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-390deeb3-e089-45e5-aa22-48ff61313d92 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:46.750988 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-390deeb3-e089-45e5-aa22-48ff61313d92 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:46.882550 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-390deeb3-e089-45e5-aa22-48ff61313d92 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.152980 Dec 16 14:46:46.883184 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 454/880] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:46 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:46.948896 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-355005cf-cde4-47e0-8d9a-3f309bf6425c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:46.949582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-355005cf-cde4-47e0-8d9a-3f309bf6425c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:46.958855 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-355005cf-cde4-47e0-8d9a-3f309bf6425c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:46.959297 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-355005cf-cde4-47e0-8d9a-3f309bf6425c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:46.960116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-355005cf-cde4-47e0-8d9a-3f309bf6425c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:46.960533 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-355005cf-cde4-47e0-8d9a-3f309bf6425c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:47.201693 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-355005cf-cde4-47e0-8d9a-3f309bf6425c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:47.211500 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-355005cf-cde4-47e0-8d9a-3f309bf6425c tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.272349 Dec 16 14:46:47.212069 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 427/881] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:46 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:47.476932 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2f055268-7e1a-4ea4-a5d3-8aaf5d1b0cd8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:47.477869 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2f055268-7e1a-4ea4-a5d3-8aaf5d1b0cd8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:47.487939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f055268-7e1a-4ea4-a5d3-8aaf5d1b0cd8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:47.488400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f055268-7e1a-4ea4-a5d3-8aaf5d1b0cd8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:47.489199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f055268-7e1a-4ea4-a5d3-8aaf5d1b0cd8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:47.489620 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f055268-7e1a-4ea4-a5d3-8aaf5d1b0cd8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:47.635712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2f055268-7e1a-4ea4-a5d3-8aaf5d1b0cd8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.168830 Dec 16 14:46:47.636464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 455/882] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:47 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:47.900247 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e53cf1f5-fa55-42f0-b3ab-8e19a75eff45 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:47.901170 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e53cf1f5-fa55-42f0-b3ab-8e19a75eff45 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:47.909489 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e53cf1f5-fa55-42f0-b3ab-8e19a75eff45 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:47.909924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e53cf1f5-fa55-42f0-b3ab-8e19a75eff45 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:47.910773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e53cf1f5-fa55-42f0-b3ab-8e19a75eff45 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:47.911176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e53cf1f5-fa55-42f0-b3ab-8e19a75eff45 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:48.094120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e53cf1f5-fa55-42f0-b3ab-8e19a75eff45 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.203160 Dec 16 14:46:48.095542 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 428/883] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:47 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:48.235664 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4718432b-3d64-4513-b6f6-818f4760b5f8 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:48.236263 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4718432b-3d64-4513-b6f6-818f4760b5f8 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:48.244919 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4718432b-3d64-4513-b6f6-818f4760b5f8 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:48.245368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4718432b-3d64-4513-b6f6-818f4760b5f8 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:48.246200 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4718432b-3d64-4513-b6f6-818f4760b5f8 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:48.246611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4718432b-3d64-4513-b6f6-818f4760b5f8 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:48.592881 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4718432b-3d64-4513-b6f6-818f4760b5f8 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:48.604099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4718432b-3d64-4513-b6f6-818f4760b5f8 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.378516 Dec 16 14:46:48.604688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 456/884] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:48 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:48.654599 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e4c13f95-0c77-4fdc-8c13-9e44a87c40e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:48.655613 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e4c13f95-0c77-4fdc-8c13-9e44a87c40e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:48.664356 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4c13f95-0c77-4fdc-8c13-9e44a87c40e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:48.664803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4c13f95-0c77-4fdc-8c13-9e44a87c40e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:48.665683 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4c13f95-0c77-4fdc-8c13-9e44a87c40e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:48.666158 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4c13f95-0c77-4fdc-8c13-9e44a87c40e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:48.794046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e4c13f95-0c77-4fdc-8c13-9e44a87c40e9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.149021 Dec 16 14:46:48.794610 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 429/885] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:48 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:49.112997 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6dd0a80d-9995-4640-bb4f-614e1b5c1a2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:49.113945 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6dd0a80d-9995-4640-bb4f-614e1b5c1a2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:49.122242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6dd0a80d-9995-4640-bb4f-614e1b5c1a2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:49.122711 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6dd0a80d-9995-4640-bb4f-614e1b5c1a2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:49.123497 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6dd0a80d-9995-4640-bb4f-614e1b5c1a2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:49.123930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6dd0a80d-9995-4640-bb4f-614e1b5c1a2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:49.258194 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6dd0a80d-9995-4640-bb4f-614e1b5c1a2f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.155639 Dec 16 14:46:49.259153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 457/886] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:49 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:46:49.629932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-059f2d80-31d2-4eb9-a97c-5ef03f4c5555 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:49.630713 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-059f2d80-31d2-4eb9-a97c-5ef03f4c5555 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:49.639214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-059f2d80-31d2-4eb9-a97c-5ef03f4c5555 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:49.639648 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-059f2d80-31d2-4eb9-a97c-5ef03f4c5555 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:49.640423 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-059f2d80-31d2-4eb9-a97c-5ef03f4c5555 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:49.640839 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-059f2d80-31d2-4eb9-a97c-5ef03f4c5555 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:49.813409 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ef957e60-8e2e-4864-afa0-a54fb8fab403 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:49.814332 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ef957e60-8e2e-4864-afa0-a54fb8fab403 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:49.823690 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ef957e60-8e2e-4864-afa0-a54fb8fab403 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:49.824227 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ef957e60-8e2e-4864-afa0-a54fb8fab403 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:49.825024 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ef957e60-8e2e-4864-afa0-a54fb8fab403 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:49.825460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ef957e60-8e2e-4864-afa0-a54fb8fab403 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:49.865591 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-059f2d80-31d2-4eb9-a97c-5ef03f4c5555 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:49.874644 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-059f2d80-31d2-4eb9-a97c-5ef03f4c5555 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.255512 Dec 16 14:46:49.875229 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 430/887] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:49 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:49.967500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ef957e60-8e2e-4864-afa0-a54fb8fab403 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.165144 Dec 16 14:46:49.968437 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 458/888] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:49 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:50.277981 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2b15fddc-1c33-4e74-b9c8-8de4e2b7167e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:50.278997 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2b15fddc-1c33-4e74-b9c8-8de4e2b7167e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:50.287461 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2b15fddc-1c33-4e74-b9c8-8de4e2b7167e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:50.287786 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2b15fddc-1c33-4e74-b9c8-8de4e2b7167e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:50.288603 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2b15fddc-1c33-4e74-b9c8-8de4e2b7167e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:50.288981 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2b15fddc-1c33-4e74-b9c8-8de4e2b7167e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:50.423712 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2b15fddc-1c33-4e74-b9c8-8de4e2b7167e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.155842 Dec 16 14:46:50.424368 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 431/889] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:50 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:50.899654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1caf6e75-4d33-4fcf-a4dd-2e96ff106b81 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:50.900457 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1caf6e75-4d33-4fcf-a4dd-2e96ff106b81 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:50.911365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1caf6e75-4d33-4fcf-a4dd-2e96ff106b81 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:50.912032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1caf6e75-4d33-4fcf-a4dd-2e96ff106b81 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:50.913081 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1caf6e75-4d33-4fcf-a4dd-2e96ff106b81 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:50.913731 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1caf6e75-4d33-4fcf-a4dd-2e96ff106b81 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:50.995605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-58a77ee6-aa6b-4742-82cc-173bd260d49c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:50.997687 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-58a77ee6-aa6b-4742-82cc-173bd260d49c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:51.010246 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58a77ee6-aa6b-4742-82cc-173bd260d49c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:51.011033 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58a77ee6-aa6b-4742-82cc-173bd260d49c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:51.012225 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58a77ee6-aa6b-4742-82cc-173bd260d49c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:51.012824 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58a77ee6-aa6b-4742-82cc-173bd260d49c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:51.170207 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-58a77ee6-aa6b-4742-82cc-173bd260d49c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.193138 Dec 16 14:46:51.171301 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 432/890] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:50 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:51.208883 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-1caf6e75-4d33-4fcf-a4dd-2e96ff106b81 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:51.223083 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1caf6e75-4d33-4fcf-a4dd-2e96ff106b81 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.334043 Dec 16 14:46:51.223784 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 459/891] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:50 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:51.443541 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-feea3e1f-c39c-4e5d-96b9-b885d33c3b86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:51.444476 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-feea3e1f-c39c-4e5d-96b9-b885d33c3b86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:51.453100 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-feea3e1f-c39c-4e5d-96b9-b885d33c3b86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:51.453595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-feea3e1f-c39c-4e5d-96b9-b885d33c3b86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:51.454645 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-feea3e1f-c39c-4e5d-96b9-b885d33c3b86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:51.455126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-feea3e1f-c39c-4e5d-96b9-b885d33c3b86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:51.587335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-feea3e1f-c39c-4e5d-96b9-b885d33c3b86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.153914 Dec 16 14:46:51.587994 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 433/892] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:51 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:52.188342 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9f7a58d1-4b04-44f9-8497-deb32cb0acaa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:52.189292 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9f7a58d1-4b04-44f9-8497-deb32cb0acaa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:52.199084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f7a58d1-4b04-44f9-8497-deb32cb0acaa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:52.199466 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f7a58d1-4b04-44f9-8497-deb32cb0acaa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:52.200341 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f7a58d1-4b04-44f9-8497-deb32cb0acaa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:52.200976 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f7a58d1-4b04-44f9-8497-deb32cb0acaa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:52.262799 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-69b9a918-91d3-4f79-a7fe-894de2fefce0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:52.264028 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-69b9a918-91d3-4f79-a7fe-894de2fefce0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:52.277729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69b9a918-91d3-4f79-a7fe-894de2fefce0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:52.278195 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69b9a918-91d3-4f79-a7fe-894de2fefce0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:52.278989 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69b9a918-91d3-4f79-a7fe-894de2fefce0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:52.279409 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69b9a918-91d3-4f79-a7fe-894de2fefce0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:52.331343 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9f7a58d1-4b04-44f9-8497-deb32cb0acaa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.152567 Dec 16 14:46:52.332483 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 460/893] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:52 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:52.441418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-3cbd2577-4527-4d67-aa0d-b20870862b0a req-b6a66caf-87f6-46d9-b15e-ccabe5076c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6e43c8-eea5-48d0-b7bf-ff18381a0f20", "name": "network-vif-plugged", "status": "completed", "tag": "a1de2547-6459-4d87-9d1f-a9adfc216809"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:52.449365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:52.449365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:46:52.459285 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-3cbd2577-4527-4d67-aa0d-b20870862b0a req-b6a66caf-87f6-46d9-b15e-ccabe5076c9f service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:52.459886 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-3cbd2577-4527-4d67-aa0d-b20870862b0a req-b6a66caf-87f6-46d9-b15e-ccabe5076c9f service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:52.479244 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-3cbd2577-4527-4d67-aa0d-b20870862b0a req-b6a66caf-87f6-46d9-b15e-ccabe5076c9f service nova] Creating event network-vif-plugged:a1de2547-6459-4d87-9d1f-a9adfc216809 for instance fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 on hv-cinder-82189 Dec 16 14:46:52.485248 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-3cbd2577-4527-4d67-aa0d-b20870862b0a req-b6a66caf-87f6-46d9-b15e-ccabe5076c9f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054363 Dec 16 14:46:52.486448 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 461/894] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:46:52.533243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-69b9a918-91d3-4f79-a7fe-894de2fefce0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:52.542913 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-69b9a918-91d3-4f79-a7fe-894de2fefce0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.300937 Dec 16 14:46:52.543489 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 434/895] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:52 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:52.615306 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7009b3e5-aa5d-493d-a0a4-9b6781b5b74f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:52.617161 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7009b3e5-aa5d-493d-a0a4-9b6781b5b74f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:52.632627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7009b3e5-aa5d-493d-a0a4-9b6781b5b74f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:52.633431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7009b3e5-aa5d-493d-a0a4-9b6781b5b74f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:52.634900 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7009b3e5-aa5d-493d-a0a4-9b6781b5b74f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:52.635689 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7009b3e5-aa5d-493d-a0a4-9b6781b5b74f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:52.821452 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7009b3e5-aa5d-493d-a0a4-9b6781b5b74f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.224377 Dec 16 14:46:52.822732 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 462/896] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:52 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:46:53.349711 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-57fe8662-834d-44a2-9316-e1f54fce78be tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:53.350703 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-57fe8662-834d-44a2-9316-e1f54fce78be tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:53.359835 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-57fe8662-834d-44a2-9316-e1f54fce78be tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:53.360390 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-57fe8662-834d-44a2-9316-e1f54fce78be tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:53.361413 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-57fe8662-834d-44a2-9316-e1f54fce78be tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:53.362003 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-57fe8662-834d-44a2-9316-e1f54fce78be tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:53.494228 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-57fe8662-834d-44a2-9316-e1f54fce78be tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.154456 Dec 16 14:46:53.494812 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 435/897] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:53 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:53.568212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-11d9df96-b662-42bf-a674-5529d823ea4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:53.568844 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-11d9df96-b662-42bf-a674-5529d823ea4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:53.577479 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-11d9df96-b662-42bf-a674-5529d823ea4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:53.577919 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-11d9df96-b662-42bf-a674-5529d823ea4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:53.578724 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-11d9df96-b662-42bf-a674-5529d823ea4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:53.579337 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-11d9df96-b662-42bf-a674-5529d823ea4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:53.812871 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-11d9df96-b662-42bf-a674-5529d823ea4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:53.825541 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-11d9df96-b662-42bf-a674-5529d823ea4b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1573 microversion: 2.1 time: 0.266989 Dec 16 14:46:53.826171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 463/898] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:53 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1573 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:53.852563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-eb26af19-2762-40cc-9397-de1090426fe9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:53.854380 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-eb26af19-2762-40cc-9397-de1090426fe9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:53.869652 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eb26af19-2762-40cc-9397-de1090426fe9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:53.870467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eb26af19-2762-40cc-9397-de1090426fe9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:53.871898 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eb26af19-2762-40cc-9397-de1090426fe9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:53.872665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eb26af19-2762-40cc-9397-de1090426fe9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:54.060901 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-eb26af19-2762-40cc-9397-de1090426fe9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.228912 Dec 16 14:46:54.061475 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 436/899] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:53 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:54.515548 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f3f40c87-5d5e-41a1-8c2f-beb02b38421d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:54.516689 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f3f40c87-5d5e-41a1-8c2f-beb02b38421d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:54.532402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3f40c87-5d5e-41a1-8c2f-beb02b38421d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:54.532402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3f40c87-5d5e-41a1-8c2f-beb02b38421d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:54.532402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3f40c87-5d5e-41a1-8c2f-beb02b38421d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:54.532402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3f40c87-5d5e-41a1-8c2f-beb02b38421d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:54.685413 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f3f40c87-5d5e-41a1-8c2f-beb02b38421d tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.180922 Dec 16 14:46:54.686182 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 464/900] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:54 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:46:54.850485 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-36263ec3-ae12-4e33-8bd0-bfa7ee621bcc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:54.851168 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-36263ec3-ae12-4e33-8bd0-bfa7ee621bcc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:54.859704 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-36263ec3-ae12-4e33-8bd0-bfa7ee621bcc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:54.860504 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-36263ec3-ae12-4e33-8bd0-bfa7ee621bcc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:54.861046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-36263ec3-ae12-4e33-8bd0-bfa7ee621bcc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:54.861563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-36263ec3-ae12-4e33-8bd0-bfa7ee621bcc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.081152 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2f4e5f74-49fb-4c0b-8d04-2c3ee5e0cc2c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:55.082433 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2f4e5f74-49fb-4c0b-8d04-2c3ee5e0cc2c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:55.091096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f4e5f74-49fb-4c0b-8d04-2c3ee5e0cc2c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.091600 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f4e5f74-49fb-4c0b-8d04-2c3ee5e0cc2c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.092311 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f4e5f74-49fb-4c0b-8d04-2c3ee5e0cc2c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.092770 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2f4e5f74-49fb-4c0b-8d04-2c3ee5e0cc2c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.114496 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-36263ec3-ae12-4e33-8bd0-bfa7ee621bcc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:46:55.134368 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-36263ec3-ae12-4e33-8bd0-bfa7ee621bcc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1560 microversion: 2.1 time: 0.291250 Dec 16 14:46:55.134368 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 437/901] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:54 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1560 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:55.248661 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2f4e5f74-49fb-4c0b-8d04-2c3ee5e0cc2c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.179295 Dec 16 14:46:55.249324 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 465/902] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:55 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:46:55.703431 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3f036a2f-ed19-4f90-ad3b-85b2d522b7bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:55.705080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3f036a2f-ed19-4f90-ad3b-85b2d522b7bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:55.719279 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f036a2f-ed19-4f90-ad3b-85b2d522b7bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.719279 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f036a2f-ed19-4f90-ad3b-85b2d522b7bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.720819 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f036a2f-ed19-4f90-ad3b-85b2d522b7bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.721325 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f036a2f-ed19-4f90-ad3b-85b2d522b7bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.891553 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3f036a2f-ed19-4f90-ad3b-85b2d522b7bf tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.197110 Dec 16 14:46:55.893403 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 438/903] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:55 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:56.267736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a3f9a472-b59b-48cc-bb11-6d8ade679cef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:56.268754 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a3f9a472-b59b-48cc-bb11-6d8ade679cef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:56.277069 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a3f9a472-b59b-48cc-bb11-6d8ade679cef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:56.277503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a3f9a472-b59b-48cc-bb11-6d8ade679cef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:56.278296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a3f9a472-b59b-48cc-bb11-6d8ade679cef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:56.278707 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a3f9a472-b59b-48cc-bb11-6d8ade679cef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:56.426727 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a3f9a472-b59b-48cc-bb11-6d8ade679cef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.169279 Dec 16 14:46:56.427487 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 466/904] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:56 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:56.918920 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a6b50f39-ed35-4879-9d7a-5dae7509b3f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:56.919983 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a6b50f39-ed35-4879-9d7a-5dae7509b3f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:56.929068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a6b50f39-ed35-4879-9d7a-5dae7509b3f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:56.929502 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a6b50f39-ed35-4879-9d7a-5dae7509b3f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:56.930339 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a6b50f39-ed35-4879-9d7a-5dae7509b3f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:56.930757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a6b50f39-ed35-4879-9d7a-5dae7509b3f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:57.080712 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a6b50f39-ed35-4879-9d7a-5dae7509b3f9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.179013 Dec 16 14:46:57.081430 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 439/905] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:56 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:57.446584 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-dff08beb-54cf-4663-ab75-84d52fa06f33 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:57.447596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-dff08beb-54cf-4663-ab75-84d52fa06f33 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:57.456777 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dff08beb-54cf-4663-ab75-84d52fa06f33 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:57.457252 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dff08beb-54cf-4663-ab75-84d52fa06f33 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:57.458141 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dff08beb-54cf-4663-ab75-84d52fa06f33 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:57.458669 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dff08beb-54cf-4663-ab75-84d52fa06f33 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:57.591952 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-dff08beb-54cf-4663-ab75-84d52fa06f33 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.155880 Dec 16 14:46:57.592653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 467/906] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:57 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:58.100858 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-23c561cb-2a2f-419d-bf09-5f06e196ac0f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:58.101866 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-23c561cb-2a2f-419d-bf09-5f06e196ac0f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:58.110563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23c561cb-2a2f-419d-bf09-5f06e196ac0f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:58.111013 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23c561cb-2a2f-419d-bf09-5f06e196ac0f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:58.111802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23c561cb-2a2f-419d-bf09-5f06e196ac0f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:58.112240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23c561cb-2a2f-419d-bf09-5f06e196ac0f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:58.244404 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-23c561cb-2a2f-419d-bf09-5f06e196ac0f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.154248 Dec 16 14:46:58.245161 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 440/907] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:58 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:58.613817 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-27e8c899-8319-4acb-9325-a4251311c6e2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:58.614880 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-27e8c899-8319-4acb-9325-a4251311c6e2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:58.623427 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27e8c899-8319-4acb-9325-a4251311c6e2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:58.623873 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27e8c899-8319-4acb-9325-a4251311c6e2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:58.624653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27e8c899-8319-4acb-9325-a4251311c6e2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:58.625075 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27e8c899-8319-4acb-9325-a4251311c6e2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:58.762024 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-27e8c899-8319-4acb-9325-a4251311c6e2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.160588 Dec 16 14:46:58.762801 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 468/908] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:58 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:59.266113 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-50fd652d-0075-44f5-b2f1-19e7ee1a6e80 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:59.267214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-50fd652d-0075-44f5-b2f1-19e7ee1a6e80 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:59.276929 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-50fd652d-0075-44f5-b2f1-19e7ee1a6e80 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:59.277463 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-50fd652d-0075-44f5-b2f1-19e7ee1a6e80 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:59.278270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-50fd652d-0075-44f5-b2f1-19e7ee1a6e80 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:59.278701 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-50fd652d-0075-44f5-b2f1-19e7ee1a6e80 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:59.429054 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-50fd652d-0075-44f5-b2f1-19e7ee1a6e80 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.175559 Dec 16 14:46:59.429609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 441/909] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:59 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:59.781031 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9bc837b2-1c50-4b65-baa5-b8cff644473c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:59.781966 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9bc837b2-1c50-4b65-baa5-b8cff644473c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:46:59.791561 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9bc837b2-1c50-4b65-baa5-b8cff644473c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:59.791995 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9bc837b2-1c50-4b65-baa5-b8cff644473c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:59.792790 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9bc837b2-1c50-4b65-baa5-b8cff644473c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:59.793216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9bc837b2-1c50-4b65-baa5-b8cff644473c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:59.950345 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9bc837b2-1c50-4b65-baa5-b8cff644473c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28224 microversion: 2.20 time: 0.179096 Dec 16 14:46:59.951010 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 469/910] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:59 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28224 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:00.448123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-35862022-7e5c-4200-83dd-6d7d68ef4ec7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:00.448994 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-35862022-7e5c-4200-83dd-6d7d68ef4ec7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:00.459240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-35862022-7e5c-4200-83dd-6d7d68ef4ec7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:00.459681 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-35862022-7e5c-4200-83dd-6d7d68ef4ec7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:00.460467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-35862022-7e5c-4200-83dd-6d7d68ef4ec7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:00.461178 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-35862022-7e5c-4200-83dd-6d7d68ef4ec7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:00.602130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-35862022-7e5c-4200-83dd-6d7d68ef4ec7 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.163851 Dec 16 14:47:00.602770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 442/911] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:00 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:00.969333 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c592ba06-928e-4603-bc96-d9ea04749894 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:00.970268 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c592ba06-928e-4603-bc96-d9ea04749894 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:00.978998 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c592ba06-928e-4603-bc96-d9ea04749894 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:00.979433 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c592ba06-928e-4603-bc96-d9ea04749894 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:00.980284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c592ba06-928e-4603-bc96-d9ea04749894 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:00.980705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c592ba06-928e-4603-bc96-d9ea04749894 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:01.131137 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c592ba06-928e-4603-bc96-d9ea04749894 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28515 microversion: 2.20 time: 0.171486 Dec 16 14:47:01.131792 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 470/912] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:00 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:01.620945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f060ff0f-8750-4c66-bdd8-721dd30bdc0b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:01.622018 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f060ff0f-8750-4c66-bdd8-721dd30bdc0b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:01.630926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f060ff0f-8750-4c66-bdd8-721dd30bdc0b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:01.631371 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f060ff0f-8750-4c66-bdd8-721dd30bdc0b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:01.632506 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f060ff0f-8750-4c66-bdd8-721dd30bdc0b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:01.632932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f060ff0f-8750-4c66-bdd8-721dd30bdc0b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:01.773504 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f060ff0f-8750-4c66-bdd8-721dd30bdc0b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.162528 Dec 16 14:47:01.774059 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 443/913] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:01 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:47:02.151478 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fb220fe0-4757-41a5-b11b-ff8d8c191beb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:02.152508 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fb220fe0-4757-41a5-b11b-ff8d8c191beb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:02.161088 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb220fe0-4757-41a5-b11b-ff8d8c191beb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:02.161548 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb220fe0-4757-41a5-b11b-ff8d8c191beb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:02.162359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb220fe0-4757-41a5-b11b-ff8d8c191beb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:02.162789 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb220fe0-4757-41a5-b11b-ff8d8c191beb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:02.318763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fb220fe0-4757-41a5-b11b-ff8d8c191beb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.178028 Dec 16 14:47:02.319423 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 471/914] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:02 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:02.792661 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e90d4ba1-725b-4430-a9d4-0d342c868b38 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:02.793585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e90d4ba1-725b-4430-a9d4-0d342c868b38 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:02.802601 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e90d4ba1-725b-4430-a9d4-0d342c868b38 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:02.803087 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e90d4ba1-725b-4430-a9d4-0d342c868b38 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:02.803862 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e90d4ba1-725b-4430-a9d4-0d342c868b38 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:02.804292 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e90d4ba1-725b-4430-a9d4-0d342c868b38 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:02.949790 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e90d4ba1-725b-4430-a9d4-0d342c868b38 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.167098 Dec 16 14:47:02.950480 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 444/915] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:02 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:03.337592 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e5c982d0-b287-4f5d-88b6-afc3ef3b6e3d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:03.338628 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e5c982d0-b287-4f5d-88b6-afc3ef3b6e3d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:03.347275 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e5c982d0-b287-4f5d-88b6-afc3ef3b6e3d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:03.347719 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e5c982d0-b287-4f5d-88b6-afc3ef3b6e3d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:03.348505 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e5c982d0-b287-4f5d-88b6-afc3ef3b6e3d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:03.348937 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e5c982d0-b287-4f5d-88b6-afc3ef3b6e3d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:03.484595 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e5c982d0-b287-4f5d-88b6-afc3ef3b6e3d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.156862 Dec 16 14:47:03.485167 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 472/916] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:03 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:03.969919 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d94094d6-87cf-4b90-b8f5-e8d84ba5ba1b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:03.970968 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d94094d6-87cf-4b90-b8f5-e8d84ba5ba1b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:03.979872 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d94094d6-87cf-4b90-b8f5-e8d84ba5ba1b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:03.980385 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d94094d6-87cf-4b90-b8f5-e8d84ba5ba1b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:03.981191 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d94094d6-87cf-4b90-b8f5-e8d84ba5ba1b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:03.981612 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d94094d6-87cf-4b90-b8f5-e8d84ba5ba1b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:04.114279 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d94094d6-87cf-4b90-b8f5-e8d84ba5ba1b tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.154509 Dec 16 14:47:04.115695 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 445/917] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:03 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:04.504238 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-37317627-0b51-493f-965c-abcb2ef204ed tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:04.505254 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-37317627-0b51-493f-965c-abcb2ef204ed tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:04.514199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-37317627-0b51-493f-965c-abcb2ef204ed tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:04.514651 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-37317627-0b51-493f-965c-abcb2ef204ed tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:04.515424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-37317627-0b51-493f-965c-abcb2ef204ed tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:04.515849 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-37317627-0b51-493f-965c-abcb2ef204ed tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:04.651028 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-37317627-0b51-493f-965c-abcb2ef204ed tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.156993 Dec 16 14:47:04.651825 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 473/918] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:04 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:47:05.133916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-69e7c95c-50c8-47aa-a6a0-ecd0d7edad91 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:05.134960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-69e7c95c-50c8-47aa-a6a0-ecd0d7edad91 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:05.143639 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69e7c95c-50c8-47aa-a6a0-ecd0d7edad91 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:05.144859 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69e7c95c-50c8-47aa-a6a0-ecd0d7edad91 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:05.145736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69e7c95c-50c8-47aa-a6a0-ecd0d7edad91 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:05.146203 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-69e7c95c-50c8-47aa-a6a0-ecd0d7edad91 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:05.273783 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-69e7c95c-50c8-47aa-a6a0-ecd0d7edad91 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.150413 Dec 16 14:47:05.274494 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 446/919] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:05 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:05.669717 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5009a51f-1e09-446d-808a-32116dc6873e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:05.670765 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5009a51f-1e09-446d-808a-32116dc6873e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:05.679351 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5009a51f-1e09-446d-808a-32116dc6873e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:05.679796 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5009a51f-1e09-446d-808a-32116dc6873e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:05.680590 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5009a51f-1e09-446d-808a-32116dc6873e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:05.681029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5009a51f-1e09-446d-808a-32116dc6873e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:05.809438 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5009a51f-1e09-446d-808a-32116dc6873e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.149480 Dec 16 14:47:05.810100 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 474/920] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:05 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:06.293374 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e9e1f189-573f-4ef9-b089-fc77957a7611 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:06.295101 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e9e1f189-573f-4ef9-b089-fc77957a7611 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:06.304090 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e9e1f189-573f-4ef9-b089-fc77957a7611 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:06.304573 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e9e1f189-573f-4ef9-b089-fc77957a7611 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:06.305345 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e9e1f189-573f-4ef9-b089-fc77957a7611 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:06.305762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e9e1f189-573f-4ef9-b089-fc77957a7611 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:06.448184 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e9e1f189-573f-4ef9-b089-fc77957a7611 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.165142 Dec 16 14:47:06.449135 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 447/921] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:06 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:06.829463 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e49465fc-f628-4065-a04e-12a5e4e6788a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:06.830295 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e49465fc-f628-4065-a04e-12a5e4e6788a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:06.838893 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e49465fc-f628-4065-a04e-12a5e4e6788a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:06.839328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e49465fc-f628-4065-a04e-12a5e4e6788a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:06.840106 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e49465fc-f628-4065-a04e-12a5e4e6788a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:06.840526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e49465fc-f628-4065-a04e-12a5e4e6788a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:06.993635 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e49465fc-f628-4065-a04e-12a5e4e6788a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.174262 Dec 16 14:47:06.994311 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 475/922] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:06 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:47:07.468555 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-556ff03c-0ec7-4105-8041-05becaa463cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:07.469559 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-556ff03c-0ec7-4105-8041-05becaa463cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:07.478251 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-556ff03c-0ec7-4105-8041-05becaa463cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:07.478698 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-556ff03c-0ec7-4105-8041-05becaa463cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:07.479470 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-556ff03c-0ec7-4105-8041-05becaa463cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:07.479894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-556ff03c-0ec7-4105-8041-05becaa463cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:07.630570 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-556ff03c-0ec7-4105-8041-05becaa463cd tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.172161 Dec 16 14:47:07.631241 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 448/923] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:07 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:47:08.014029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6fdf5627-c525-40ea-8825-f89a50d7149c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:08.015166 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6fdf5627-c525-40ea-8825-f89a50d7149c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:08.025010 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6fdf5627-c525-40ea-8825-f89a50d7149c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:08.025524 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6fdf5627-c525-40ea-8825-f89a50d7149c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:08.026539 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6fdf5627-c525-40ea-8825-f89a50d7149c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:08.027022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6fdf5627-c525-40ea-8825-f89a50d7149c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:08.188111 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6fdf5627-c525-40ea-8825-f89a50d7149c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.185214 Dec 16 14:47:08.188911 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 476/924] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:08 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:08.649872 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-072d590b-5d88-4a25-a28f-abbb34062b65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:08.650868 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-072d590b-5d88-4a25-a28f-abbb34062b65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:08.659556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-072d590b-5d88-4a25-a28f-abbb34062b65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:08.660005 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-072d590b-5d88-4a25-a28f-abbb34062b65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:08.660925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-072d590b-5d88-4a25-a28f-abbb34062b65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:08.661342 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-072d590b-5d88-4a25-a28f-abbb34062b65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:08.796478 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-072d590b-5d88-4a25-a28f-abbb34062b65 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.156469 Dec 16 14:47:08.797251 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 449/925] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:08 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:09.208624 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b4c41775-c71c-4c38-85cf-eaf56c07a329 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:09.209679 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b4c41775-c71c-4c38-85cf-eaf56c07a329 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:09.218254 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b4c41775-c71c-4c38-85cf-eaf56c07a329 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:09.222030 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b4c41775-c71c-4c38-85cf-eaf56c07a329 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:09.222030 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b4c41775-c71c-4c38-85cf-eaf56c07a329 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:09.222030 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b4c41775-c71c-4c38-85cf-eaf56c07a329 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:09.369604 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b4c41775-c71c-4c38-85cf-eaf56c07a329 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.171652 Dec 16 14:47:09.370601 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 477/926] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:09 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:09.815553 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2d9ed515-3df5-40a3-a070-c5e18e46a21f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:09.816990 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2d9ed515-3df5-40a3-a070-c5e18e46a21f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:09.826492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2d9ed515-3df5-40a3-a070-c5e18e46a21f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:09.827074 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2d9ed515-3df5-40a3-a070-c5e18e46a21f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:09.828363 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2d9ed515-3df5-40a3-a070-c5e18e46a21f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:09.828798 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2d9ed515-3df5-40a3-a070-c5e18e46a21f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:09.982851 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2d9ed515-3df5-40a3-a070-c5e18e46a21f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.177073 Dec 16 14:47:09.983723 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 450/927] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:09 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:10.390374 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fbac8139-b545-450e-ba0a-248a58042e90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:10.391530 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fbac8139-b545-450e-ba0a-248a58042e90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:10.401646 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fbac8139-b545-450e-ba0a-248a58042e90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:10.402191 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fbac8139-b545-450e-ba0a-248a58042e90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:10.403032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fbac8139-b545-450e-ba0a-248a58042e90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:10.403605 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fbac8139-b545-450e-ba0a-248a58042e90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:10.553421 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fbac8139-b545-450e-ba0a-248a58042e90 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.174187 Dec 16 14:47:10.554638 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 478/928] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:10 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:11.017561 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8036c03b-76e3-40e5-bb46-87c2faf2a4d5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:11.020078 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8036c03b-76e3-40e5-bb46-87c2faf2a4d5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:11.035761 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8036c03b-76e3-40e5-bb46-87c2faf2a4d5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:11.036554 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8036c03b-76e3-40e5-bb46-87c2faf2a4d5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:11.037958 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8036c03b-76e3-40e5-bb46-87c2faf2a4d5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:11.038726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8036c03b-76e3-40e5-bb46-87c2faf2a4d5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:11.287334 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8036c03b-76e3-40e5-bb46-87c2faf2a4d5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.291226 Dec 16 14:47:11.288099 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 451/929] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:10 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:11.575132 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cfb32698-23f1-45b5-8004-bed710c7dc6c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:11.576069 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cfb32698-23f1-45b5-8004-bed710c7dc6c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:11.592516 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cfb32698-23f1-45b5-8004-bed710c7dc6c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:11.593600 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cfb32698-23f1-45b5-8004-bed710c7dc6c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:11.595035 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cfb32698-23f1-45b5-8004-bed710c7dc6c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:11.595815 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-cfb32698-23f1-45b5-8004-bed710c7dc6c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:11.739935 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cfb32698-23f1-45b5-8004-bed710c7dc6c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.175222 Dec 16 14:47:11.740588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 479/930] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:11 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:12.311411 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a55805b7-7b1d-4d74-8cfe-dc0afbd70107 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:12.315257 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a55805b7-7b1d-4d74-8cfe-dc0afbd70107 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:12.324453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a55805b7-7b1d-4d74-8cfe-dc0afbd70107 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:12.324890 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a55805b7-7b1d-4d74-8cfe-dc0afbd70107 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:12.325674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a55805b7-7b1d-4d74-8cfe-dc0afbd70107 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:12.326129 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a55805b7-7b1d-4d74-8cfe-dc0afbd70107 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:12.462968 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a55805b7-7b1d-4d74-8cfe-dc0afbd70107 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.164151 Dec 16 14:47:12.463624 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 452/931] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:12 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:12.759366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1feb25d5-6719-40b6-b20d-40f447be872f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:12.760385 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1feb25d5-6719-40b6-b20d-40f447be872f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:12.770284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1feb25d5-6719-40b6-b20d-40f447be872f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:12.770746 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1feb25d5-6719-40b6-b20d-40f447be872f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:12.771546 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1feb25d5-6719-40b6-b20d-40f447be872f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:12.771973 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1feb25d5-6719-40b6-b20d-40f447be872f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:12.912147 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1feb25d5-6719-40b6-b20d-40f447be872f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.163274 Dec 16 14:47:12.912774 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 480/932] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:12 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:13.487326 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f9dc8d05-9a1b-4a8a-b409-7f42c9cd8b45 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:13.489822 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f9dc8d05-9a1b-4a8a-b409-7f42c9cd8b45 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:13.502563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f9dc8d05-9a1b-4a8a-b409-7f42c9cd8b45 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:13.503181 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f9dc8d05-9a1b-4a8a-b409-7f42c9cd8b45 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:13.504113 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f9dc8d05-9a1b-4a8a-b409-7f42c9cd8b45 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:13.504916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f9dc8d05-9a1b-4a8a-b409-7f42c9cd8b45 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:13.644467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f9dc8d05-9a1b-4a8a-b409-7f42c9cd8b45 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.172393 Dec 16 14:47:13.646297 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 453/933] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:13 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:47:13.931292 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-43bd0c6a-3c9c-4af4-8d36-83fe04f58d40 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:13.932309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-43bd0c6a-3c9c-4af4-8d36-83fe04f58d40 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:13.940647 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-43bd0c6a-3c9c-4af4-8d36-83fe04f58d40 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:13.941154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-43bd0c6a-3c9c-4af4-8d36-83fe04f58d40 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:13.942630 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-43bd0c6a-3c9c-4af4-8d36-83fe04f58d40 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:13.943075 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-43bd0c6a-3c9c-4af4-8d36-83fe04f58d40 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:14.089958 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-43bd0c6a-3c9c-4af4-8d36-83fe04f58d40 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.169035 Dec 16 14:47:14.090816 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 481/934] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:13 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:14.665682 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cf518c87-2a31-4c47-b7f3-f20011f45339 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:14.666727 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cf518c87-2a31-4c47-b7f3-f20011f45339 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:14.675314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf518c87-2a31-4c47-b7f3-f20011f45339 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:14.675920 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf518c87-2a31-4c47-b7f3-f20011f45339 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:14.676685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf518c87-2a31-4c47-b7f3-f20011f45339 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:14.677156 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf518c87-2a31-4c47-b7f3-f20011f45339 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:14.810235 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cf518c87-2a31-4c47-b7f3-f20011f45339 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.154134 Dec 16 14:47:14.810896 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 454/935] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:14 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:15.109441 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f0d5a67d-68f4-41bd-9538-f45af5be01c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:15.110460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f0d5a67d-68f4-41bd-9538-f45af5be01c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:15.119255 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f0d5a67d-68f4-41bd-9538-f45af5be01c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:15.119700 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f0d5a67d-68f4-41bd-9538-f45af5be01c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:15.120477 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f0d5a67d-68f4-41bd-9538-f45af5be01c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:15.120900 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f0d5a67d-68f4-41bd-9538-f45af5be01c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:15.255355 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f0d5a67d-68f4-41bd-9538-f45af5be01c9 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.155296 Dec 16 14:47:15.256027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 482/936] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:15 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:15.829191 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-87b73f9b-9883-48f1-a3f5-a013d8afd5f5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:15.830224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-87b73f9b-9883-48f1-a3f5-a013d8afd5f5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:15.839805 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-87b73f9b-9883-48f1-a3f5-a013d8afd5f5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:15.840250 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-87b73f9b-9883-48f1-a3f5-a013d8afd5f5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:15.841043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-87b73f9b-9883-48f1-a3f5-a013d8afd5f5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:15.841464 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-87b73f9b-9883-48f1-a3f5-a013d8afd5f5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:15.981765 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-87b73f9b-9883-48f1-a3f5-a013d8afd5f5 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.162702 Dec 16 14:47:15.982452 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 455/937] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:15 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:16.274619 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-046b0fe4-f170-4bdb-936d-3d3049482265 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:16.275630 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-046b0fe4-f170-4bdb-936d-3d3049482265 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:16.284136 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-046b0fe4-f170-4bdb-936d-3d3049482265 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:16.284577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-046b0fe4-f170-4bdb-936d-3d3049482265 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:16.285342 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-046b0fe4-f170-4bdb-936d-3d3049482265 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:16.285808 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-046b0fe4-f170-4bdb-936d-3d3049482265 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:16.419980 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-046b0fe4-f170-4bdb-936d-3d3049482265 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.155197 Dec 16 14:47:16.420561 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 483/938] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:16 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:17.000434 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-eacfcf5d-8a01-4dd9-9e71-e74957900883 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:17.001317 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-eacfcf5d-8a01-4dd9-9e71-e74957900883 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:17.010852 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eacfcf5d-8a01-4dd9-9e71-e74957900883 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:17.011435 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eacfcf5d-8a01-4dd9-9e71-e74957900883 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:17.012339 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eacfcf5d-8a01-4dd9-9e71-e74957900883 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:17.012803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-eacfcf5d-8a01-4dd9-9e71-e74957900883 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:17.167993 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-eacfcf5d-8a01-4dd9-9e71-e74957900883 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.177289 Dec 16 14:47:17.167993 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 456/939] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:16 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:47:17.438701 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ff2e260d-2d3b-4dbc-aee6-a0980c4c2b97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:17.439733 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ff2e260d-2d3b-4dbc-aee6-a0980c4c2b97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:17.449727 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ff2e260d-2d3b-4dbc-aee6-a0980c4c2b97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:17.450257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ff2e260d-2d3b-4dbc-aee6-a0980c4c2b97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:17.451121 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ff2e260d-2d3b-4dbc-aee6-a0980c4c2b97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:17.451594 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ff2e260d-2d3b-4dbc-aee6-a0980c4c2b97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:17.596391 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ff2e260d-2d3b-4dbc-aee6-a0980c4c2b97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.167544 Dec 16 14:47:17.597081 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 484/940] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:17 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:18.186161 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-193fb95d-37cd-42aa-b56b-22bee2167637 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:18.187173 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-193fb95d-37cd-42aa-b56b-22bee2167637 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:18.196108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-193fb95d-37cd-42aa-b56b-22bee2167637 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:18.196574 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-193fb95d-37cd-42aa-b56b-22bee2167637 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:18.197352 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-193fb95d-37cd-42aa-b56b-22bee2167637 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:18.197763 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-193fb95d-37cd-42aa-b56b-22bee2167637 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:18.328206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-193fb95d-37cd-42aa-b56b-22bee2167637 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.151971 Dec 16 14:47:18.328862 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 457/941] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:18 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:18.616505 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-78b3f4cb-d264-49ee-aef4-84a88b6079c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:18.617526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-78b3f4cb-d264-49ee-aef4-84a88b6079c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:18.627008 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-78b3f4cb-d264-49ee-aef4-84a88b6079c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:18.630858 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-78b3f4cb-d264-49ee-aef4-84a88b6079c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:18.631716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-78b3f4cb-d264-49ee-aef4-84a88b6079c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:18.632154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-78b3f4cb-d264-49ee-aef4-84a88b6079c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:18.761431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-78b3f4cb-d264-49ee-aef4-84a88b6079c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.155065 Dec 16 14:47:18.762098 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 485/942] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:18 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:47:19.347014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-19332612-83eb-4f3b-9a09-5a89791fd3f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:19.348301 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-19332612-83eb-4f3b-9a09-5a89791fd3f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:19.360579 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-19332612-83eb-4f3b-9a09-5a89791fd3f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:19.361032 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-19332612-83eb-4f3b-9a09-5a89791fd3f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:19.361813 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-19332612-83eb-4f3b-9a09-5a89791fd3f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:19.362278 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-19332612-83eb-4f3b-9a09-5a89791fd3f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:19.491116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-19332612-83eb-4f3b-9a09-5a89791fd3f6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.153828 Dec 16 14:47:19.491774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 458/943] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:19 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:19.781201 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9521d3cf-62d4-4196-9595-245293a2519b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:19.782124 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9521d3cf-62d4-4196-9595-245293a2519b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:19.790496 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9521d3cf-62d4-4196-9595-245293a2519b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:19.790943 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9521d3cf-62d4-4196-9595-245293a2519b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:19.791713 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9521d3cf-62d4-4196-9595-245293a2519b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:19.792130 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9521d3cf-62d4-4196-9595-245293a2519b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:19.915288 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9521d3cf-62d4-4196-9595-245293a2519b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.145459 Dec 16 14:47:19.915975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 486/944] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:19 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:20.511764 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f64186f3-d121-4488-91bd-8abc85e12a9f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:20.512675 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f64186f3-d121-4488-91bd-8abc85e12a9f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:20.521120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f64186f3-d121-4488-91bd-8abc85e12a9f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:20.521563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f64186f3-d121-4488-91bd-8abc85e12a9f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:20.522371 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f64186f3-d121-4488-91bd-8abc85e12a9f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:20.522806 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f64186f3-d121-4488-91bd-8abc85e12a9f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:20.669517 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f64186f3-d121-4488-91bd-8abc85e12a9f tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 28644 microversion: 2.1 time: 0.168261 Dec 16 14:47:20.670479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 459/945] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:20 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 28644 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:20.933847 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0458f48d-71da-454a-a47a-70c6959f62a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:20.934912 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0458f48d-71da-454a-a47a-70c6959f62a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:20.943575 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0458f48d-71da-454a-a47a-70c6959f62a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:20.944055 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0458f48d-71da-454a-a47a-70c6959f62a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:20.944843 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0458f48d-71da-454a-a47a-70c6959f62a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:20.945270 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0458f48d-71da-454a-a47a-70c6959f62a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:21.223941 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0458f48d-71da-454a-a47a-70c6959f62a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.299806 Dec 16 14:47:21.224455 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 487/946] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:20 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:21.690156 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3f36fe54-da7e-4c9f-8d45-5563a617e874 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:21.691193 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3f36fe54-da7e-4c9f-8d45-5563a617e874 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:21.700939 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f36fe54-da7e-4c9f-8d45-5563a617e874 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:21.701382 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f36fe54-da7e-4c9f-8d45-5563a617e874 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:21.702227 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f36fe54-da7e-4c9f-8d45-5563a617e874 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:21.702662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3f36fe54-da7e-4c9f-8d45-5563a617e874 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:21.994743 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3f36fe54-da7e-4c9f-8d45-5563a617e874 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 30235 microversion: 2.1 time: 0.314311 Dec 16 14:47:21.995298 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 460/947] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:21 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 30235 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:22.243500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4f67de08-cdcd-4868-8ca4-15b7d6a57a29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:22.244524 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4f67de08-cdcd-4868-8ca4-15b7d6a57a29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:22.252873 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4f67de08-cdcd-4868-8ca4-15b7d6a57a29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:22.253231 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4f67de08-cdcd-4868-8ca4-15b7d6a57a29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:22.253981 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4f67de08-cdcd-4868-8ca4-15b7d6a57a29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:22.254431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4f67de08-cdcd-4868-8ca4-15b7d6a57a29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:22.389302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4f67de08-cdcd-4868-8ca4-15b7d6a57a29 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.156180 Dec 16 14:47:22.390206 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 488/948] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:22 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:23.012780 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3bae2f7c-aea9-4908-b14e-8373e1e85419 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:23.013817 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3bae2f7c-aea9-4908-b14e-8373e1e85419 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:23.022857 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3bae2f7c-aea9-4908-b14e-8373e1e85419 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:23.023300 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3bae2f7c-aea9-4908-b14e-8373e1e85419 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:23.024098 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3bae2f7c-aea9-4908-b14e-8373e1e85419 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:23.024524 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3bae2f7c-aea9-4908-b14e-8373e1e85419 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:23.183375 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3bae2f7c-aea9-4908-b14e-8373e1e85419 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 32169 microversion: 2.1 time: 0.180705 Dec 16 14:47:23.184213 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 461/949] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:23 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 32169 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:23.408807 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-db3daf37-f9ca-467b-8fdb-5dc47aaa1a44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:23.409865 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-db3daf37-f9ca-467b-8fdb-5dc47aaa1a44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:23.418649 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-db3daf37-f9ca-467b-8fdb-5dc47aaa1a44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:23.419097 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-db3daf37-f9ca-467b-8fdb-5dc47aaa1a44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:23.419899 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-db3daf37-f9ca-467b-8fdb-5dc47aaa1a44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:23.420333 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-db3daf37-f9ca-467b-8fdb-5dc47aaa1a44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:23.562771 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-db3daf37-f9ca-467b-8fdb-5dc47aaa1a44 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.163511 Dec 16 14:47:23.563435 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 489/950] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:23 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:24.204499 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-07853452-125f-4420-bc63-d935eb708a07 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:24.205501 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-07853452-125f-4420-bc63-d935eb708a07 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:24.214214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-07853452-125f-4420-bc63-d935eb708a07 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.214672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-07853452-125f-4420-bc63-d935eb708a07 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.215474 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-07853452-125f-4420-bc63-d935eb708a07 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.216008 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-07853452-125f-4420-bc63-d935eb708a07 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.296897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4fe8de55-cd0b-4f2a-808e-ceb98e9f8ab3 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:24.297959 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4fe8de55-cd0b-4f2a-808e-ceb98e9f8ab3 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:24.307602 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4fe8de55-cd0b-4f2a-808e-ceb98e9f8ab3 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.307987 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4fe8de55-cd0b-4f2a-808e-ceb98e9f8ab3 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.308762 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4fe8de55-cd0b-4f2a-808e-ceb98e9f8ab3 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.309184 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4fe8de55-cd0b-4f2a-808e-ceb98e9f8ab3 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.365773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-07853452-125f-4420-bc63-d935eb708a07 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 33204 microversion: 2.1 time: 0.170448 Dec 16 14:47:24.366585 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 462/951] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:24 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 33204 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:47:24.471473 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4fe8de55-cd0b-4f2a-808e-ceb98e9f8ab3 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "POST /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/action" status: 202 len: 0 microversion: 2.1 time: 0.185992 Dec 16 14:47:24.472381 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 490/952] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:24 2021] POST /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:24.496225 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-277dbb2d-3eaa-4930-b46a-4024a8e69f4c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:24.497296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-277dbb2d-3eaa-4930-b46a-4024a8e69f4c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:24.508130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-277dbb2d-3eaa-4930-b46a-4024a8e69f4c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.508578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-277dbb2d-3eaa-4930-b46a-4024a8e69f4c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.509727 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-277dbb2d-3eaa-4930-b46a-4024a8e69f4c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.510235 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-277dbb2d-3eaa-4930-b46a-4024a8e69f4c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.581442 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4dc5d29d-9fe7-4b07-b481-6ef8c3a91322 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:24.582534 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4dc5d29d-9fe7-4b07-b481-6ef8c3a91322 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:24.592578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dc5d29d-9fe7-4b07-b481-6ef8c3a91322 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.593212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dc5d29d-9fe7-4b07-b481-6ef8c3a91322 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.594118 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dc5d29d-9fe7-4b07-b481-6ef8c3a91322 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.594694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dc5d29d-9fe7-4b07-b481-6ef8c3a91322 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.760358 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4dc5d29d-9fe7-4b07-b481-6ef8c3a91322 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.187975 Dec 16 14:47:24.760887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-277dbb2d-3eaa-4930-b46a-4024a8e69f4c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:24.761491 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 491/953] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:24 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:47:24.771641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-277dbb2d-3eaa-4930-b46a-4024a8e69f4c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1748 microversion: 2.1 time: 0.291269 Dec 16 14:47:24.772315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 463/954] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:24 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1748 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:25.384988 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-61150fca-ecf4-4d54-a9b5-ee0ca65bfdad tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:25.386032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-61150fca-ecf4-4d54-a9b5-ee0ca65bfdad tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:25.394769 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-61150fca-ecf4-4d54-a9b5-ee0ca65bfdad tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.395229 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-61150fca-ecf4-4d54-a9b5-ee0ca65bfdad tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.396226 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-61150fca-ecf4-4d54-a9b5-ee0ca65bfdad tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.396658 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-61150fca-ecf4-4d54-a9b5-ee0ca65bfdad tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.561091 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-61150fca-ecf4-4d54-a9b5-ee0ca65bfdad tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 34258 microversion: 2.1 time: 0.186837 Dec 16 14:47:25.561965 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 492/955] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:25 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 34258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:47:25.784925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1afcfeb0-5736-469a-b6b4-6bae13608096 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:25.785838 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1afcfeb0-5736-469a-b6b4-6bae13608096 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:25.797014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1afcfeb0-5736-469a-b6b4-6bae13608096 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.797014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1afcfeb0-5736-469a-b6b4-6bae13608096 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.805160 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1afcfeb0-5736-469a-b6b4-6bae13608096 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.805160 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1afcfeb0-5736-469a-b6b4-6bae13608096 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.808405 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-73f42c89-fbef-4994-b73e-3ee60cb967ed tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:25.809443 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-73f42c89-fbef-4994-b73e-3ee60cb967ed tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:25.835251 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-73f42c89-fbef-4994-b73e-3ee60cb967ed tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.835251 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-73f42c89-fbef-4994-b73e-3ee60cb967ed tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.836086 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-73f42c89-fbef-4994-b73e-3ee60cb967ed tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.837002 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-73f42c89-fbef-4994-b73e-3ee60cb967ed tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.941023 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1afcfeb0-5736-469a-b6b4-6bae13608096 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.169137 Dec 16 14:47:25.941793 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 464/956] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:25 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:26.082663 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-73f42c89-fbef-4994-b73e-3ee60cb967ed tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:26.092920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-73f42c89-fbef-4994-b73e-3ee60cb967ed tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1753 microversion: 2.1 time: 0.305617 Dec 16 14:47:26.093629 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 493/957] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:25 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1753 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:26.580855 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0f59648e-b170-4100-ace9-64864e3b35c1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:26.581850 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0f59648e-b170-4100-ace9-64864e3b35c1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:26.591468 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0f59648e-b170-4100-ace9-64864e3b35c1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:26.591909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0f59648e-b170-4100-ace9-64864e3b35c1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:26.592714 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0f59648e-b170-4100-ace9-64864e3b35c1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:26.593143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0f59648e-b170-4100-ace9-64864e3b35c1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:26.747388 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0f59648e-b170-4100-ace9-64864e3b35c1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 35491 microversion: 2.1 time: 0.176097 Dec 16 14:47:26.748160 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 465/958] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:26 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 35491 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:26.960631 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d71e7a7b-9b3e-4c38-a520-5557740c8892 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:26.961645 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d71e7a7b-9b3e-4c38-a520-5557740c8892 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:26.971404 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d71e7a7b-9b3e-4c38-a520-5557740c8892 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:26.971854 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d71e7a7b-9b3e-4c38-a520-5557740c8892 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:26.972653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d71e7a7b-9b3e-4c38-a520-5557740c8892 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:26.973081 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d71e7a7b-9b3e-4c38-a520-5557740c8892 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:27.115504 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d71e7a7b-9b3e-4c38-a520-5557740c8892 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.164845 Dec 16 14:47:27.117608 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 494/959] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:26 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:27.130667 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-23785ad8-6d43-4517-99b8-08afcaa46ef5 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:27.131759 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-23785ad8-6d43-4517-99b8-08afcaa46ef5 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:27.141075 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23785ad8-6d43-4517-99b8-08afcaa46ef5 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:27.141516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23785ad8-6d43-4517-99b8-08afcaa46ef5 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:27.142344 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23785ad8-6d43-4517-99b8-08afcaa46ef5 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:27.142802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23785ad8-6d43-4517-99b8-08afcaa46ef5 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:27.376526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-23785ad8-6d43-4517-99b8-08afcaa46ef5 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:27.387051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-23785ad8-6d43-4517-99b8-08afcaa46ef5 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1753 microversion: 2.1 time: 0.277918 Dec 16 14:47:27.387641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 466/960] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:27 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1753 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:27.767356 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e1fa8c42-67f9-412c-861c-04fb6bc1e3b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:27.768491 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e1fa8c42-67f9-412c-861c-04fb6bc1e3b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:27.777707 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1fa8c42-67f9-412c-861c-04fb6bc1e3b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:27.778189 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1fa8c42-67f9-412c-861c-04fb6bc1e3b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:27.779009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1fa8c42-67f9-412c-861c-04fb6bc1e3b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:27.779411 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1fa8c42-67f9-412c-861c-04fb6bc1e3b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:27.944028 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e1fa8c42-67f9-412c-861c-04fb6bc1e3b1 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 37038 microversion: 2.1 time: 0.186285 Dec 16 14:47:27.945482 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 495/961] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:27 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 37038 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:28.137855 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d8702392-419a-4f80-921f-0ab6f0f33e6b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:28.138857 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d8702392-419a-4f80-921f-0ab6f0f33e6b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:28.148595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d8702392-419a-4f80-921f-0ab6f0f33e6b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.149028 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d8702392-419a-4f80-921f-0ab6f0f33e6b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:28.149806 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d8702392-419a-4f80-921f-0ab6f0f33e6b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.150302 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d8702392-419a-4f80-921f-0ab6f0f33e6b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:28.285363 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d8702392-419a-4f80-921f-0ab6f0f33e6b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.159072 Dec 16 14:47:28.286100 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 467/962] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:28 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:28.412280 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b3a8ba88-b82f-44ee-93c1-de975ea11385 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:28.413128 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b3a8ba88-b82f-44ee-93c1-de975ea11385 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:28.421701 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b3a8ba88-b82f-44ee-93c1-de975ea11385 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.422189 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b3a8ba88-b82f-44ee-93c1-de975ea11385 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:28.422993 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b3a8ba88-b82f-44ee-93c1-de975ea11385 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.423432 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b3a8ba88-b82f-44ee-93c1-de975ea11385 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:28.659748 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b3a8ba88-b82f-44ee-93c1-de975ea11385 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:28.669806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b3a8ba88-b82f-44ee-93c1-de975ea11385 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1753 microversion: 2.1 time: 0.267371 Dec 16 14:47:28.670274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 496/963] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:28 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1753 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:28.968645 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b97070d9-c988-4518-8f42-aebe3a011504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:28.970277 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b97070d9-c988-4518-8f42-aebe3a011504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:28.980359 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b97070d9-c988-4518-8f42-aebe3a011504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.980795 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b97070d9-c988-4518-8f42-aebe3a011504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:28.981602 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b97070d9-c988-4518-8f42-aebe3a011504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.982059 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b97070d9-c988-4518-8f42-aebe3a011504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:29.137894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b97070d9-c988-4518-8f42-aebe3a011504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 38177 microversion: 2.1 time: 0.182226 Dec 16 14:47:29.138601 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 468/964] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:28 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 38177 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:29.308047 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c99afe27-a701-4aef-9e20-3de32bfc5d18 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:29.308679 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c99afe27-a701-4aef-9e20-3de32bfc5d18 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:29.317357 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c99afe27-a701-4aef-9e20-3de32bfc5d18 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:29.317796 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c99afe27-a701-4aef-9e20-3de32bfc5d18 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:29.318888 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c99afe27-a701-4aef-9e20-3de32bfc5d18 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:29.319483 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c99afe27-a701-4aef-9e20-3de32bfc5d18 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:29.462171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c99afe27-a701-4aef-9e20-3de32bfc5d18 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.167567 Dec 16 14:47:29.463298 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 497/965] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:29 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:29.694888 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-daff5750-ec87-4cae-afe6-538bdcd11023 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:29.695676 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-daff5750-ec87-4cae-afe6-538bdcd11023 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:29.708315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-daff5750-ec87-4cae-afe6-538bdcd11023 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:29.711469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-daff5750-ec87-4cae-afe6-538bdcd11023 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:29.711469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-daff5750-ec87-4cae-afe6-538bdcd11023 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:29.711898 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-daff5750-ec87-4cae-afe6-538bdcd11023 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:29.999774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-daff5750-ec87-4cae-afe6-538bdcd11023 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:30.013842 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-daff5750-ec87-4cae-afe6-538bdcd11023 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1753 microversion: 2.1 time: 0.329718 Dec 16 14:47:30.014802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 469/966] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:29 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1753 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:30.157100 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-99b9fa54-95ca-4344-b319-3139d7d717c2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:30.158265 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-99b9fa54-95ca-4344-b319-3139d7d717c2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:30.167551 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99b9fa54-95ca-4344-b319-3139d7d717c2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:30.167983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99b9fa54-95ca-4344-b319-3139d7d717c2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:30.169417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99b9fa54-95ca-4344-b319-3139d7d717c2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:30.169417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99b9fa54-95ca-4344-b319-3139d7d717c2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:30.311741 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-99b9fa54-95ca-4344-b319-3139d7d717c2 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 38177 microversion: 2.1 time: 0.164603 Dec 16 14:47:30.313692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 498/967] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:30 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 38177 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:30.482660 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-458c983f-56a8-48c0-91ba-a7a5e00b5da2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:30.483598 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-458c983f-56a8-48c0-91ba-a7a5e00b5da2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:30.491976 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-458c983f-56a8-48c0-91ba-a7a5e00b5da2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:30.492433 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-458c983f-56a8-48c0-91ba-a7a5e00b5da2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:30.493208 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-458c983f-56a8-48c0-91ba-a7a5e00b5da2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:30.493633 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-458c983f-56a8-48c0-91ba-a7a5e00b5da2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:30.621424 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-458c983f-56a8-48c0-91ba-a7a5e00b5da2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.148815 Dec 16 14:47:30.622105 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 470/968] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:30 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:31.046889 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c62a19b4-60ac-49d4-bfb0-51744a1d7e12 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:31.047774 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c62a19b4-60ac-49d4-bfb0-51744a1d7e12 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:31.058983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c62a19b4-60ac-49d4-bfb0-51744a1d7e12 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:31.059574 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c62a19b4-60ac-49d4-bfb0-51744a1d7e12 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:31.060492 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c62a19b4-60ac-49d4-bfb0-51744a1d7e12 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:31.061220 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c62a19b4-60ac-49d4-bfb0-51744a1d7e12 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:31.321673 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c62a19b4-60ac-49d4-bfb0-51744a1d7e12 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:31.331748 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c62a19b4-60ac-49d4-bfb0-51744a1d7e12 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1753 microversion: 2.1 time: 0.301231 Dec 16 14:47:31.332328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 499/969] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:31 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1753 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:31.342225 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-59700e79-7fee-47d4-bdeb-f8b86aa198fb tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:31.344089 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-59700e79-7fee-47d4-bdeb-f8b86aa198fb tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:31.356858 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-59700e79-7fee-47d4-bdeb-f8b86aa198fb tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:31.357350 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-59700e79-7fee-47d4-bdeb-f8b86aa198fb tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:31.358347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-59700e79-7fee-47d4-bdeb-f8b86aa198fb tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:31.358861 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-59700e79-7fee-47d4-bdeb-f8b86aa198fb tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:31.554804 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-59700e79-7fee-47d4-bdeb-f8b86aa198fb tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 38177 microversion: 2.1 time: 0.232512 Dec 16 14:47:31.555857 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 471/970] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:31 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 38177 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:47:31.639877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-72d50900-882d-40ec-90b7-5234a6f839ef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:31.640801 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-72d50900-882d-40ec-90b7-5234a6f839ef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:31.648919 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-72d50900-882d-40ec-90b7-5234a6f839ef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:31.649364 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-72d50900-882d-40ec-90b7-5234a6f839ef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:31.650197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-72d50900-882d-40ec-90b7-5234a6f839ef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:31.650637 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-72d50900-882d-40ec-90b7-5234a6f839ef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:31.794003 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-72d50900-882d-40ec-90b7-5234a6f839ef tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.164134 Dec 16 14:47:31.794857 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 500/971] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:31 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:32.357830 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5802e955-b2b4-458d-8bb6-2061af53d2b8 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:32.358572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5802e955-b2b4-458d-8bb6-2061af53d2b8 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:32.367727 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5802e955-b2b4-458d-8bb6-2061af53d2b8 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.368173 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5802e955-b2b4-458d-8bb6-2061af53d2b8 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.368988 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5802e955-b2b4-458d-8bb6-2061af53d2b8 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.369418 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5802e955-b2b4-458d-8bb6-2061af53d2b8 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.578355 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-04bfb55e-a771-459a-baa1-70b0686b0df8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:32.579503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-04bfb55e-a771-459a-baa1-70b0686b0df8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:32.589057 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04bfb55e-a771-459a-baa1-70b0686b0df8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.589500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04bfb55e-a771-459a-baa1-70b0686b0df8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.590339 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04bfb55e-a771-459a-baa1-70b0686b0df8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.590761 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-04bfb55e-a771-459a-baa1-70b0686b0df8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.594393 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5802e955-b2b4-458d-8bb6-2061af53d2b8 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:32.604292 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5802e955-b2b4-458d-8bb6-2061af53d2b8 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1753 microversion: 2.1 time: 0.257378 Dec 16 14:47:32.604858 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 472/972] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:32 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1753 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:32.744226 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-04bfb55e-a771-459a-baa1-70b0686b0df8 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 38190 microversion: 2.1 time: 0.176833 Dec 16 14:47:32.744800 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 501/973] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:32 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 38190 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:32.815067 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0c570031-0e9b-47aa-8182-dcac30d3161f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:32.815986 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0c570031-0e9b-47aa-8182-dcac30d3161f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:32.824354 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c570031-0e9b-47aa-8182-dcac30d3161f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.824782 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c570031-0e9b-47aa-8182-dcac30d3161f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.825575 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c570031-0e9b-47aa-8182-dcac30d3161f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.826017 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0c570031-0e9b-47aa-8182-dcac30d3161f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.958551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0c570031-0e9b-47aa-8182-dcac30d3161f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.152825 Dec 16 14:47:32.959375 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 473/974] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:32 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:47:33.628238 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-70424439-0fa5-4085-ae8e-f4d7a3c7a13e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:33.628951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-70424439-0fa5-4085-ae8e-f4d7a3c7a13e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:33.637916 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-70424439-0fa5-4085-ae8e-f4d7a3c7a13e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:33.638361 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-70424439-0fa5-4085-ae8e-f4d7a3c7a13e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:33.639176 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-70424439-0fa5-4085-ae8e-f4d7a3c7a13e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:33.639603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-70424439-0fa5-4085-ae8e-f4d7a3c7a13e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:33.763497 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-29bfda4a-e75e-40e8-a31c-508671e1e1b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:33.764655 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-29bfda4a-e75e-40e8-a31c-508671e1e1b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:33.773229 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-29bfda4a-e75e-40e8-a31c-508671e1e1b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:33.773683 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-29bfda4a-e75e-40e8-a31c-508671e1e1b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:33.774558 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-29bfda4a-e75e-40e8-a31c-508671e1e1b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:33.774979 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-29bfda4a-e75e-40e8-a31c-508671e1e1b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:33.876388 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-70424439-0fa5-4085-ae8e-f4d7a3c7a13e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:33.886625 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-70424439-0fa5-4085-ae8e-f4d7a3c7a13e tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1753 microversion: 2.1 time: 0.268009 Dec 16 14:47:33.887111 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 502/975] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:33 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1753 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:33.921038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-29bfda4a-e75e-40e8-a31c-508671e1e1b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action" status: 200 len: 38308 microversion: 2.1 time: 0.167544 Dec 16 14:47:33.922115 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 474/976] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:33 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/action => generated 38308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:47:33.938573 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0f77f5ac-4bb2-49e8-8c76-aaf4bf36f993 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:33.939064 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0f77f5ac-4bb2-49e8-8c76-aaf4bf36f993 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:33.947088 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f77f5ac-4bb2-49e8-8c76-aaf4bf36f993 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:33.947581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f77f5ac-4bb2-49e8-8c76-aaf4bf36f993 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:33.948368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f77f5ac-4bb2-49e8-8c76-aaf4bf36f993 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:33.948802 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f77f5ac-4bb2-49e8-8c76-aaf4bf36f993 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:33.982446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1283c74c-ca53-4d4a-91da-74d9147d8b6d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:33.984246 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1283c74c-ca53-4d4a-91da-74d9147d8b6d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:33.999613 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1283c74c-ca53-4d4a-91da-74d9147d8b6d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:34.000413 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1283c74c-ca53-4d4a-91da-74d9147d8b6d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:34.001802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1283c74c-ca53-4d4a-91da-74d9147d8b6d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:34.002568 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1283c74c-ca53-4d4a-91da-74d9147d8b6d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:34.017040 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0f77f5ac-4bb2-49e8-8c76-aaf4bf36f993 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/ips" status: 200 len: 146 microversion: 2.1 time: 0.088564 Dec 16 14:47:34.017629 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 503/977] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Dec 16 14:47:33 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/ips => generated 146 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:34.186941 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1283c74c-ca53-4d4a-91da-74d9147d8b6d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.218642 Dec 16 14:47:34.187636 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 475/978] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:33 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:47:34.909846 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-02332892-c567-4f1a-9fc1-9d9d3c33bd0f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:34.910542 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-02332892-c567-4f1a-9fc1-9d9d3c33bd0f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:34.921145 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-02332892-c567-4f1a-9fc1-9d9d3c33bd0f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:34.921717 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-02332892-c567-4f1a-9fc1-9d9d3c33bd0f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:34.922899 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-02332892-c567-4f1a-9fc1-9d9d3c33bd0f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:34.923596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-02332892-c567-4f1a-9fc1-9d9d3c33bd0f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:35.141257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-02332892-c567-4f1a-9fc1-9d9d3c33bd0f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:35.151031 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-02332892-c567-4f1a-9fc1-9d9d3c33bd0f tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1753 microversion: 2.1 time: 0.251488 Dec 16 14:47:35.151596 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 504/979] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:34 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1753 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:35.206006 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d9f1b9a2-c417-4f3b-a2f1-f9d53918c7df tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:35.207039 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d9f1b9a2-c417-4f3b-a2f1-f9d53918c7df tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:35.216076 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d9f1b9a2-c417-4f3b-a2f1-f9d53918c7df tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:35.216516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d9f1b9a2-c417-4f3b-a2f1-f9d53918c7df tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:35.217284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d9f1b9a2-c417-4f3b-a2f1-f9d53918c7df tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:35.217721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d9f1b9a2-c417-4f3b-a2f1-f9d53918c7df tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:35.355894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d9f1b9a2-c417-4f3b-a2f1-f9d53918c7df tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.159734 Dec 16 14:47:35.356574 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 476/980] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:35 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:47:35.662265 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-27dd422b-361d-48dc-8fb3-6c42c83d1504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a93a7635-cfef-40b7-8452-f911c714b54f"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:35.663401 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-27dd422b-361d-48dc-8fb3-6c42c83d1504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:35.672264 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27dd422b-361d-48dc-8fb3-6c42c83d1504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:35.672691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27dd422b-361d-48dc-8fb3-6c42c83d1504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:35.673460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27dd422b-361d-48dc-8fb3-6c42c83d1504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:35.673921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-27dd422b-361d-48dc-8fb3-6c42c83d1504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:36.090478 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-27dd422b-361d-48dc-8fb3-6c42c83d1504 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437844 Dec 16 14:47:36.091562 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 505/981] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:47:35 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:47:36.175335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ee0ad1a6-bf0e-4989-a2ad-e56b6a4dec51 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:36.176101 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ee0ad1a6-bf0e-4989-a2ad-e56b6a4dec51 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:36.185446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee0ad1a6-bf0e-4989-a2ad-e56b6a4dec51 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:36.186253 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee0ad1a6-bf0e-4989-a2ad-e56b6a4dec51 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:36.187041 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee0ad1a6-bf0e-4989-a2ad-e56b6a4dec51 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:36.187467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee0ad1a6-bf0e-4989-a2ad-e56b6a4dec51 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:36.376639 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-15aeb1da-bcc4-4fc5-bf03-8d0c211361f2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:36.377683 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-15aeb1da-bcc4-4fc5-bf03-8d0c211361f2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:36.387146 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-15aeb1da-bcc4-4fc5-bf03-8d0c211361f2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:36.387623 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-15aeb1da-bcc4-4fc5-bf03-8d0c211361f2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:36.388441 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-15aeb1da-bcc4-4fc5-bf03-8d0c211361f2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:36.389070 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-15aeb1da-bcc4-4fc5-bf03-8d0c211361f2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:36.403606 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ee0ad1a6-bf0e-4989-a2ad-e56b6a4dec51 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:36.413153 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ee0ad1a6-bf0e-4989-a2ad-e56b6a4dec51 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1753 microversion: 2.1 time: 0.248038 Dec 16 14:47:36.413898 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 477/982] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:36 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1753 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:36.595552 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-15aeb1da-bcc4-4fc5-bf03-8d0c211361f2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 28683 microversion: 2.20 time: 0.229549 Dec 16 14:47:36.596066 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 506/983] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:36 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 28683 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:37.435574 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ac79af40-0cec-42ec-ba47-c130184685c6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:37.436177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ac79af40-0cec-42ec-ba47-c130184685c6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:37.444446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac79af40-0cec-42ec-ba47-c130184685c6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.444886 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac79af40-0cec-42ec-ba47-c130184685c6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.445670 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac79af40-0cec-42ec-ba47-c130184685c6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.446120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac79af40-0cec-42ec-ba47-c130184685c6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.613415 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-220010cb-de1d-4c9d-addf-ad1cfb47e406 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:37.614472 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-220010cb-de1d-4c9d-addf-ad1cfb47e406 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:37.622951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-220010cb-de1d-4c9d-addf-ad1cfb47e406 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.623396 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-220010cb-de1d-4c9d-addf-ad1cfb47e406 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.624178 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-220010cb-de1d-4c9d-addf-ad1cfb47e406 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.624665 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-220010cb-de1d-4c9d-addf-ad1cfb47e406 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.660044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ac79af40-0cec-42ec-ba47-c130184685c6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:37.668941 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ac79af40-0cec-42ec-ba47-c130184685c6 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1756 microversion: 2.1 time: 0.242867 Dec 16 14:47:37.669479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 478/984] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:37 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:37.770833 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-220010cb-de1d-4c9d-addf-ad1cfb47e406 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 29432 microversion: 2.20 time: 0.166768 Dec 16 14:47:37.771504 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 507/985] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:37 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 29432 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:38.789086 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e56624c6-ce77-4506-b53d-26d00566cd0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:38.790026 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e56624c6-ce77-4506-b53d-26d00566cd0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:38.798011 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e56624c6-ce77-4506-b53d-26d00566cd0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:38.798479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e56624c6-ce77-4506-b53d-26d00566cd0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:38.799254 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e56624c6-ce77-4506-b53d-26d00566cd0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:38.799683 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e56624c6-ce77-4506-b53d-26d00566cd0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:38.939511 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e56624c6-ce77-4506-b53d-26d00566cd0e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 31622 microversion: 2.20 time: 0.159439 Dec 16 14:47:38.940446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 479/986] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:38 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 31622 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:39.959522 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-999da3d9-78aa-402f-8047-0ecb1469c6b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:39.960627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-999da3d9-78aa-402f-8047-0ecb1469c6b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:39.969033 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-999da3d9-78aa-402f-8047-0ecb1469c6b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:39.969565 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-999da3d9-78aa-402f-8047-0ecb1469c6b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:39.970360 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-999da3d9-78aa-402f-8047-0ecb1469c6b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:39.970780 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-999da3d9-78aa-402f-8047-0ecb1469c6b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:40.116424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-999da3d9-78aa-402f-8047-0ecb1469c6b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 33297 microversion: 2.20 time: 0.166631 Dec 16 14:47:40.117434 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 508/987] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:39 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 33297 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:41.135609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cd8d8b23-47b8-43e6-a8f4-aa384d43358f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:41.136627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cd8d8b23-47b8-43e6-a8f4-aa384d43358f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:41.145166 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd8d8b23-47b8-43e6-a8f4-aa384d43358f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:41.145605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd8d8b23-47b8-43e6-a8f4-aa384d43358f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:41.146396 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd8d8b23-47b8-43e6-a8f4-aa384d43358f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:41.146818 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cd8d8b23-47b8-43e6-a8f4-aa384d43358f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:41.290785 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cd8d8b23-47b8-43e6-a8f4-aa384d43358f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 34243 microversion: 2.20 time: 0.165320 Dec 16 14:47:41.291531 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 480/988] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:41 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 34243 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:42.311400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f76dbec2-410b-41c1-8785-604965df8e62 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:42.312321 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f76dbec2-410b-41c1-8785-604965df8e62 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:42.320857 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f76dbec2-410b-41c1-8785-604965df8e62 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:42.321310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f76dbec2-410b-41c1-8785-604965df8e62 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:42.322124 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f76dbec2-410b-41c1-8785-604965df8e62 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:42.322557 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f76dbec2-410b-41c1-8785-604965df8e62 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:42.474090 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f76dbec2-410b-41c1-8785-604965df8e62 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 35361 microversion: 2.20 time: 0.173521 Dec 16 14:47:42.474739 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 509/989] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:42 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 35361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:43.495309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-63efd012-6031-477b-8a09-52860c5e3297 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:43.496208 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-63efd012-6031-477b-8a09-52860c5e3297 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:43.504360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63efd012-6031-477b-8a09-52860c5e3297 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:43.504793 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63efd012-6031-477b-8a09-52860c5e3297 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:43.505594 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63efd012-6031-477b-8a09-52860c5e3297 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:43.506009 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63efd012-6031-477b-8a09-52860c5e3297 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:43.652224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-63efd012-6031-477b-8a09-52860c5e3297 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 36670 microversion: 2.20 time: 0.169192 Dec 16 14:47:43.652882 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 481/990] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:43 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 36670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:44.031517 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d4679690-d09e-4d90-a4a3-3bd972b7faec tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:44.032539 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d4679690-d09e-4d90-a4a3-3bd972b7faec tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:44.042210 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d4679690-d09e-4d90-a4a3-3bd972b7faec tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.042210 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d4679690-d09e-4d90-a4a3-3bd972b7faec tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.042903 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d4679690-d09e-4d90-a4a3-3bd972b7faec tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.043327 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d4679690-d09e-4d90-a4a3-3bd972b7faec tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.127641 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d4679690-d09e-4d90-a4a3-3bd972b7faec tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106344 Dec 16 14:47:44.128538 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 510/991] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:47:44 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:44.146564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7143a7c8-0655-4678-8605-25323e4d6764 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:44.147721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7143a7c8-0655-4678-8605-25323e4d6764 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:44.156459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7143a7c8-0655-4678-8605-25323e4d6764 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.157093 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7143a7c8-0655-4678-8605-25323e4d6764 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.158035 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7143a7c8-0655-4678-8605-25323e4d6764 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.158471 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7143a7c8-0655-4678-8605-25323e4d6764 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.231597 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7143a7c8-0655-4678-8605-25323e4d6764 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/a93a7635-cfef-40b7-8452-f911c714b54f" status: 200 len: 194 microversion: 2.1 time: 0.096116 Dec 16 14:47:44.236771 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 482/992] 10.222.0.67 () {58 vars in 1412 bytes} [Thu Dec 16 14:47:44 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/a93a7635-cfef-40b7-8452-f911c714b54f => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:44.670798 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7426a653-fbfd-4435-bce5-f3541929bd93 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:44.671775 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7426a653-fbfd-4435-bce5-f3541929bd93 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:44.680585 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7426a653-fbfd-4435-bce5-f3541929bd93 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.681284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7426a653-fbfd-4435-bce5-f3541929bd93 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.682312 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7426a653-fbfd-4435-bce5-f3541929bd93 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.682729 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7426a653-fbfd-4435-bce5-f3541929bd93 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.832200 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7426a653-fbfd-4435-bce5-f3541929bd93 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 38213 microversion: 2.20 time: 0.170841 Dec 16 14:47:44.832920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 511/993] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:44 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 38213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:47:45.851178 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-80f2b433-6e81-4f2d-a93f-a3eb6c0ec1e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:45.851746 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-80f2b433-6e81-4f2d-a93f-a3eb6c0ec1e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:45.860552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80f2b433-6e81-4f2d-a93f-a3eb6c0ec1e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:45.861299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80f2b433-6e81-4f2d-a93f-a3eb6c0ec1e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:45.862510 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80f2b433-6e81-4f2d-a93f-a3eb6c0ec1e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:45.863008 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80f2b433-6e81-4f2d-a93f-a3eb6c0ec1e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:45.896196 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3271254b-b926-45d5-8eb4-6aa5dc80f525 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b801a024-1d5e-4b2a-a7e7-e5a6055cac60"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:45.897374 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3271254b-b926-45d5-8eb4-6aa5dc80f525 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:45.906697 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3271254b-b926-45d5-8eb4-6aa5dc80f525 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:45.907148 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3271254b-b926-45d5-8eb4-6aa5dc80f525 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:45.907961 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3271254b-b926-45d5-8eb4-6aa5dc80f525 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:45.908387 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3271254b-b926-45d5-8eb4-6aa5dc80f525 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:46.008860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-80f2b433-6e81-4f2d-a93f-a3eb6c0ec1e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 38241 microversion: 2.20 time: 0.167550 Dec 16 14:47:46.010321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 483/994] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:45 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 38241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:46.606453 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3271254b-b926-45d5-8eb4-6aa5dc80f525 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720414 Dec 16 14:47:46.607098 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 512/995] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:47:45 2021] POST /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:47.033053 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d9ed04e3-2596-45cc-b489-8ff6ba75ccc4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:47.033970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d9ed04e3-2596-45cc-b489-8ff6ba75ccc4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:47.043492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d9ed04e3-2596-45cc-b489-8ff6ba75ccc4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:47.043922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d9ed04e3-2596-45cc-b489-8ff6ba75ccc4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:47.044718 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d9ed04e3-2596-45cc-b489-8ff6ba75ccc4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:47.045118 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d9ed04e3-2596-45cc-b489-8ff6ba75ccc4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:47.195135 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d9ed04e3-2596-45cc-b489-8ff6ba75ccc4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 38241 microversion: 2.20 time: 0.175131 Dec 16 14:47:47.195810 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 484/996] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:47 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 38241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:48.214471 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f90f0514-8220-45de-a7ef-3ca191104c17 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:48.215555 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f90f0514-8220-45de-a7ef-3ca191104c17 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:48.224837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f90f0514-8220-45de-a7ef-3ca191104c17 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:48.225281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f90f0514-8220-45de-a7ef-3ca191104c17 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:48.226103 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f90f0514-8220-45de-a7ef-3ca191104c17 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:48.226528 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f90f0514-8220-45de-a7ef-3ca191104c17 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:48.367099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f90f0514-8220-45de-a7ef-3ca191104c17 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 38241 microversion: 2.20 time: 0.162349 Dec 16 14:47:48.367754 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 513/997] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:48 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 38241 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:49.387427 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-63ff5802-147a-4d0d-9ef9-f5e21a14dcca tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:49.388468 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-63ff5802-147a-4d0d-9ef9-f5e21a14dcca tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:49.397231 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63ff5802-147a-4d0d-9ef9-f5e21a14dcca tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:49.397672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63ff5802-147a-4d0d-9ef9-f5e21a14dcca tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:49.398537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63ff5802-147a-4d0d-9ef9-f5e21a14dcca tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:49.398961 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-63ff5802-147a-4d0d-9ef9-f5e21a14dcca tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:49.540862 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-63ff5802-147a-4d0d-9ef9-f5e21a14dcca tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 200 len: 38384 microversion: 2.20 time: 0.163245 Dec 16 14:47:49.541826 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 485/998] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:49 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 38384 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:49.564320 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ed4be5a4-a0b5-487a-818c-aea0a908a113 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:49.564900 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ed4be5a4-a0b5-487a-818c-aea0a908a113 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:49.575104 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed4be5a4-a0b5-487a-818c-aea0a908a113 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:49.575543 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed4be5a4-a0b5-487a-818c-aea0a908a113 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:49.576333 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed4be5a4-a0b5-487a-818c-aea0a908a113 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:49.576768 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed4be5a4-a0b5-487a-818c-aea0a908a113 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:49.645335 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ed4be5a4-a0b5-487a-818c-aea0a908a113 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/ips" status: 200 len: 153 microversion: 2.20 time: 0.092932 Dec 16 14:47:49.645894 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 514/999] 10.222.0.67 () {60 vars in 1288 bytes} [Thu Dec 16 14:47:49 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/ips => generated 153 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:52.104429 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-23188b70-03f4-4ddc-bf86-6c6d7f68a3c1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:52.105031 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-23188b70-03f4-4ddc-bf86-6c6d7f68a3c1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:52.108513 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:47:52.108699 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: Thu Dec 16 14:47:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action (ip 10.222.0.67) !!! Dec 16 14:47:52.124832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23188b70-03f4-4ddc-bf86-6c6d7f68a3c1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:52.125265 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23188b70-03f4-4ddc-bf86-6c6d7f68a3c1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:52.126369 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23188b70-03f4-4ddc-bf86-6c6d7f68a3c1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:52.126506 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-23188b70-03f4-4ddc-bf86-6c6d7f68a3c1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:52.191010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.objects.instance [None req-23188b70-03f4-4ddc-bf86-6c6d7f68a3c1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lazy-loading 'flavor' on Instance uuid 1bd517a0-bd8a-4e52-93ac-304678993d24 {{(pid=96669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:47:52.663971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-23188b70-03f4-4ddc-bf86-6c6d7f68a3c1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 202 len: 0 microversion: 2.20 time: 0.569963 Dec 16 14:47:52.664637 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 486/1000] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:47:52 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:47:52.678816 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:52.679438 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:52.687526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:52.687953 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:52.688703 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:52.689132 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:52.910022 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:52.923948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:52.931959 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:52.933197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-789266db-1169-4e95-b29a-16f1f37cafb4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.264068 Dec 16 14:47:52.933762 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 515/1001] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:47:52 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:47:53.960135 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:53.960832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:53.970016 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:53.970507 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:53.971457 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:53.971884 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:54.210451 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:54.225341 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:54.232413 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:54.233544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3013a21f-1c46-4675-a78d-1b5204954201 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.284321 Dec 16 14:47:54.234099 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 487/1002] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:47:53 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:47:54.614918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5b67cd3a-b03c-4e49-ba72-30d490b547b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:54.615826 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5b67cd3a-b03c-4e49-ba72-30d490b547b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:54.625223 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b67cd3a-b03c-4e49-ba72-30d490b547b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:54.625852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b67cd3a-b03c-4e49-ba72-30d490b547b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:54.627015 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b67cd3a-b03c-4e49-ba72-30d490b547b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:54.627573 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5b67cd3a-b03c-4e49-ba72-30d490b547b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:54.703114 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5b67cd3a-b03c-4e49-ba72-30d490b547b6 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.098034 Dec 16 14:47:54.703760 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 516/1003] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:47:54 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments => generated 371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:54.891741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b1b7fa90-7442-47f5-9fbd-4977e96cad70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:54.892210 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b1b7fa90-7442-47f5-9fbd-4977e96cad70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:54.900104 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b1b7fa90-7442-47f5-9fbd-4977e96cad70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:54.900546 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b1b7fa90-7442-47f5-9fbd-4977e96cad70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:54.901372 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b1b7fa90-7442-47f5-9fbd-4977e96cad70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:54.901773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b1b7fa90-7442-47f5-9fbd-4977e96cad70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:54.972152 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b1b7fa90-7442-47f5-9fbd-4977e96cad70 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/a93a7635-cfef-40b7-8452-f911c714b54f" status: 200 len: 194 microversion: 2.1 time: 0.090166 Dec 16 14:47:54.972909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 488/1004] 10.222.0.67 () {58 vars in 1412 bytes} [Thu Dec 16 14:47:54 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/a93a7635-cfef-40b7-8452-f911c714b54f => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:54.989087 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-eaff2d63-94e3-4403-b686-b30570466017 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:54.989571 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-eaff2d63-94e3-4403-b686-b30570466017 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:54.997254 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-eaff2d63-94e3-4403-b686-b30570466017 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:54.997691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-eaff2d63-94e3-4403-b686-b30570466017 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:54.998504 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-eaff2d63-94e3-4403-b686-b30570466017 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:54.998926 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-eaff2d63-94e3-4403-b686-b30570466017 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:55.278253 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-eaff2d63-94e3-4403-b686-b30570466017 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/a93a7635-cfef-40b7-8452-f911c714b54f" status: 202 len: 0 microversion: 2.1 time: 0.297771 Dec 16 14:47:55.279160 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 517/1005] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:47:54 2021] DELETE /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/a93a7635-cfef-40b7-8452-f911c714b54f => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:55.464717 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:55.465447 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:55.473092 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:55.473533 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:55.474325 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:55.474755 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:55.686747 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:55.701817 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:55.708127 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:55.709288 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a97e8b92-8b3d-40c4-80a5-4b62b3ea3403 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.460309 Dec 16 14:47:55.709834 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 489/1006] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:47:55 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:47:56.735116 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:56.735815 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:56.743893 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:56.744329 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:56.745119 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:56.745539 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:56.964608 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:56.978498 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:56.984839 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:56.985968 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c6306c61-15ae-4903-aba3-c0373376ca0c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.261564 Dec 16 14:47:56.986516 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 518/1007] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:47:56 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:47:57.609133 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7401bea9-6cdc-4c81-97dc-39af05148734 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:57.609946 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7401bea9-6cdc-4c81-97dc-39af05148734 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:57.617884 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7401bea9-6cdc-4c81-97dc-39af05148734 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:57.618364 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7401bea9-6cdc-4c81-97dc-39af05148734 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:57.619138 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7401bea9-6cdc-4c81-97dc-39af05148734 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:57.619570 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7401bea9-6cdc-4c81-97dc-39af05148734 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:57.693875 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7401bea9-6cdc-4c81-97dc-39af05148734 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/b801a024-1d5e-4b2a-a7e7-e5a6055cac60" status: 200 len: 194 microversion: 2.1 time: 0.094707 Dec 16 14:47:57.694726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 490/1008] 10.222.0.67 () {58 vars in 1412 bytes} [Thu Dec 16 14:47:57 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/b801a024-1d5e-4b2a-a7e7-e5a6055cac60 => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:57.715608 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-122c2f64-9d59-4f25-b562-0675cf68206c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:57.716555 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-122c2f64-9d59-4f25-b562-0675cf68206c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:57.724603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-122c2f64-9d59-4f25-b562-0675cf68206c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:57.725166 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-122c2f64-9d59-4f25-b562-0675cf68206c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:57.725928 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-122c2f64-9d59-4f25-b562-0675cf68206c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:57.726378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-122c2f64-9d59-4f25-b562-0675cf68206c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:58.011888 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:58.013118 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:58.026532 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:58.026993 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:58.027994 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:58.028337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:58.231562 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-122c2f64-9d59-4f25-b562-0675cf68206c tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/b801a024-1d5e-4b2a-a7e7-e5a6055cac60" status: 202 len: 0 microversion: 2.1 time: 0.526723 Dec 16 14:47:58.237703 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 519/1009] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:47:57 2021] DELETE /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments/b801a024-1d5e-4b2a-a7e7-e5a6055cac60 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:58.353245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:58.369325 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:58.376697 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:58.378032 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fc905636-47e6-4e55-8433-d97051afae86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.377085 Dec 16 14:47:58.378662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 491/1010] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:47:57 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:47:59.404595 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:59.405368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:59.414368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:59.414754 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:59.415834 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:59.416306 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:59.645162 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cdbc2b07-5dc2-4f86-bab5-015b348f7906 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:59.646340 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cdbc2b07-5dc2-4f86-bab5-015b348f7906 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:59.654356 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdbc2b07-5dc2-4f86-bab5-015b348f7906 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:59.654827 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdbc2b07-5dc2-4f86-bab5-015b348f7906 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:59.655903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdbc2b07-5dc2-4f86-bab5-015b348f7906 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:59.656082 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cdbc2b07-5dc2-4f86-bab5-015b348f7906 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:59.687418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:59.703263 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:59.709880 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:47:59.711197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-049951b1-85bd-4373-9633-209bdd76e3e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.317828 Dec 16 14:47:59.711818 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 520/1011] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:47:59 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:47:59.736738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cdbc2b07-5dc2-4f86-bab5-015b348f7906 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101799 Dec 16 14:47:59.737315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 492/1012] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:47:59 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:47:59.961195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b73a4aee-296f-440e-a56a-f2f61cafff43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:59.962259 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b73a4aee-296f-440e-a56a-f2f61cafff43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:47:59.971213 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b73a4aee-296f-440e-a56a-f2f61cafff43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:59.971654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b73a4aee-296f-440e-a56a-f2f61cafff43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:59.972636 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b73a4aee-296f-440e-a56a-f2f61cafff43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:59.973067 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b73a4aee-296f-440e-a56a-f2f61cafff43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:00.076438 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b73a4aee-296f-440e-a56a-f2f61cafff43 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125889 Dec 16 14:48:00.077403 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 521/1013] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:47:59 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:48:00.199147 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b983e3eb-bbcd-4610-830f-51dc4be87005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:00.199526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b983e3eb-bbcd-4610-830f-51dc4be87005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:00.208656 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b983e3eb-bbcd-4610-830f-51dc4be87005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:00.209106 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b983e3eb-bbcd-4610-830f-51dc4be87005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:00.209894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b983e3eb-bbcd-4610-830f-51dc4be87005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:00.210357 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b983e3eb-bbcd-4610-830f-51dc4be87005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:00.292556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b983e3eb-bbcd-4610-830f-51dc4be87005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:48:00.446197 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b983e3eb-bbcd-4610-830f-51dc4be87005 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 204 len: 0 microversion: 2.1 time: 0.256436 Dec 16 14:48:00.446907 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 493/1014] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:48:00 2021] DELETE /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:48:00.462925 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f8f0af80-2d38-4a3b-9818-5d69974aad25 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:00.463827 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f8f0af80-2d38-4a3b-9818-5d69974aad25 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:00.472666 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f8f0af80-2d38-4a3b-9818-5d69974aad25 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:00.473204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f8f0af80-2d38-4a3b-9818-5d69974aad25 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:00.474400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f8f0af80-2d38-4a3b-9818-5d69974aad25 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:00.475004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f8f0af80-2d38-4a3b-9818-5d69974aad25 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:00.742466 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f8f0af80-2d38-4a3b-9818-5d69974aad25 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:00.747231 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:00.748525 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:00.753122 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f8f0af80-2d38-4a3b-9818-5d69974aad25 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1672 microversion: 2.1 time: 0.300735 Dec 16 14:48:00.753803 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 522/1015] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:00 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1672 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:00.762835 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:00.763745 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:00.765261 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:00.766119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:01.071871 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:01.087120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:01.095008 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:01.096206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-899d9615-4aee-4248-8775-cd39ccacd38b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.368644 Dec 16 14:48:01.096822 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 494/1016] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:00 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:01.777845 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a32e2d43-7717-4447-878e-bad1593bfd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:01.778689 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a32e2d43-7717-4447-878e-bad1593bfd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:01.786386 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a32e2d43-7717-4447-878e-bad1593bfd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:01.786852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a32e2d43-7717-4447-878e-bad1593bfd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:01.787621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a32e2d43-7717-4447-878e-bad1593bfd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:01.788047 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a32e2d43-7717-4447-878e-bad1593bfd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:02.001936 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a32e2d43-7717-4447-878e-bad1593bfd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:02.010871 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a32e2d43-7717-4447-878e-bad1593bfd9a tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1672 microversion: 2.1 time: 0.242674 Dec 16 14:48:02.011439 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 523/1017] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:01 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1672 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:02.123698 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:02.124381 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:02.134732 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:02.135394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:02.136396 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:02.137424 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:02.357652 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:02.372405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:02.379163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:02.380236 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ccd12065-76a3-47d5-8c6d-dc1f865b0819 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.267199 Dec 16 14:48:02.380773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 495/1018] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:02 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:03.041713 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-77aad428-778d-4627-846f-97b322bbf690 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:03.042572 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-77aad428-778d-4627-846f-97b322bbf690 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:03.050661 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-77aad428-778d-4627-846f-97b322bbf690 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:03.051101 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-77aad428-778d-4627-846f-97b322bbf690 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:03.054463 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-77aad428-778d-4627-846f-97b322bbf690 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:03.054978 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-77aad428-778d-4627-846f-97b322bbf690 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:03.405968 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:03.406734 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:03.414565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:03.415044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:03.415838 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:03.416262 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:03.641895 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-77aad428-778d-4627-846f-97b322bbf690 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:03.655126 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-77aad428-778d-4627-846f-97b322bbf690 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1672 microversion: 2.1 time: 0.628711 Dec 16 14:48:03.662920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 524/1019] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:03 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1672 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:03.711707 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:03.726805 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:03.733649 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:03.734830 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-54eea926-409e-4433-be87-50edfcbca3a3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.339429 Dec 16 14:48:03.735371 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 496/1020] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:03 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:48:04.678706 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b7816eb6-8d98-4de2-92d3-02195b5c97b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:04.679271 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b7816eb6-8d98-4de2-92d3-02195b5c97b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:04.687748 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b7816eb6-8d98-4de2-92d3-02195b5c97b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:04.688312 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b7816eb6-8d98-4de2-92d3-02195b5c97b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:04.689156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b7816eb6-8d98-4de2-92d3-02195b5c97b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:04.689763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b7816eb6-8d98-4de2-92d3-02195b5c97b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:04.718926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-4082a15b-af20-49d4-b381-89a261e7daad req-d15b4e9d-87f3-499e-b908-5681886f3c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8693cb4-e6b1-4956-a996-04effeb71f79", "name": "network-vif-deleted", "tag": "87c2d9a0-97d2-4890-8290-54947fa974e9"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:04.727139 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:48:04.727139 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:48:04.737697 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-4082a15b-af20-49d4-b381-89a261e7daad req-d15b4e9d-87f3-499e-b908-5681886f3c1d service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:04.738304 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-4082a15b-af20-49d4-b381-89a261e7daad req-d15b4e9d-87f3-499e-b908-5681886f3c1d service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:04.757419 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-4082a15b-af20-49d4-b381-89a261e7daad req-d15b4e9d-87f3-499e-b908-5681886f3c1d service nova] Creating event network-vif-deleted:87c2d9a0-97d2-4890-8290-54947fa974e9 for instance a8693cb4-e6b1-4956-a996-04effeb71f79 on hv-cinder-82189 Dec 16 14:48:04.765112 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-4082a15b-af20-49d4-b381-89a261e7daad req-d15b4e9d-87f3-499e-b908-5681886f3c1d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059702 Dec 16 14:48:04.766237 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 497/1021] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:48:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:04.778221 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:04.779922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:04.788089 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:04.788828 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:04.789802 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:04.790443 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:04.879722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b7816eb6-8d98-4de2-92d3-02195b5c97b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6c792676f1498e98f638a268abf1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78091827c644b1fb185ec17f9aa73e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:04.892918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b7816eb6-8d98-4de2-92d3-02195b5c97b3 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 200 len: 1605 microversion: 2.1 time: 0.224069 Dec 16 14:48:04.893800 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 525/1022] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:04 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:05.024146 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:05.038960 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:05.045449 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:05.046711 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8bfb0334-4a18-4b66-ad79-b277a22b8d7c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.279039 Dec 16 14:48:05.047320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 498/1023] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:04 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:05.916856 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ebeeb7c0-480c-4df3-bee4-f8caccf2e5aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:05.917468 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ebeeb7c0-480c-4df3-bee4-f8caccf2e5aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:05.925755 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ebeeb7c0-480c-4df3-bee4-f8caccf2e5aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:05.926268 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ebeeb7c0-480c-4df3-bee4-f8caccf2e5aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:05.927071 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ebeeb7c0-480c-4df3-bee4-f8caccf2e5aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:05.927514 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ebeeb7c0-480c-4df3-bee4-f8caccf2e5aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:05.984073 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-ebeeb7c0-480c-4df3-bee4-f8caccf2e5aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] HTTP exception thrown: Instance a8693cb4-e6b1-4956-a996-04effeb71f79 could not be found. Dec 16 14:48:05.984716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ebeeb7c0-480c-4df3-bee4-f8caccf2e5aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Returning 404 to user: Instance a8693cb4-e6b1-4956-a996-04effeb71f79 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:48:05.985577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ebeeb7c0-480c-4df3-bee4-f8caccf2e5aa tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 404 len: 111 microversion: 2.1 time: 0.078686 Dec 16 14:48:05.986166 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 526/1024] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:05 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:48:06.000489 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-da30b28c-46b0-40df-89ba-464f7ae6fca4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '.version_select at 0x7f26fe4ce4c0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:06.027388 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-da30b28c-46b0-40df-89ba-464f7ae6fca4 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-70758270" status: 202 len: 0 microversion: 2.1 time: 0.036174 Dec 16 14:48:06.028302 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 499/1025] 10.222.0.67 () {58 vars in 1214 bytes} [Thu Dec 16 14:48:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-70758270 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:48:06.072145 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:06.072922 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:06.082141 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:06.082591 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:06.083386 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:06.083812 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:06.354890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:06.383192 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:06.398390 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:06.400347 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d17c3241-beb0-4e65-b895-d8107273a304 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.338367 Dec 16 14:48:06.401560 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 527/1026] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:06 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:07.436055 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:07.436736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:07.445321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:07.445757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:07.446786 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:07.447207 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:07.679832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:07.698453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:07.705649 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:07.706821 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-31dda569-4ae1-4985-9388-d4968a7106b3 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.281980 Dec 16 14:48:07.707368 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 500/1027] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:07 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:08.730921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:08.731623 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:08.741188 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:08.741864 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:08.742725 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:08.743242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:08.960740 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:08.976042 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:08.983347 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:08.984528 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2bb1f06d-3ecb-45bc-bd84-1c07cf050a30 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.263602 Dec 16 14:48:08.985089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 528/1028] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:08 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:09.842926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-67f81411-690c-4218-9070-dbe2d045d20e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:09.843540 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-67f81411-690c-4218-9070-dbe2d045d20e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:09.851925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-67f81411-690c-4218-9070-dbe2d045d20e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:09.852424 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-67f81411-690c-4218-9070-dbe2d045d20e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:09.853347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-67f81411-690c-4218-9070-dbe2d045d20e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:09.853842 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-67f81411-690c-4218-9070-dbe2d045d20e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:09.923093 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-67f81411-690c-4218-9070-dbe2d045d20e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] HTTP exception thrown: Instance a8693cb4-e6b1-4956-a996-04effeb71f79 could not be found. Dec 16 14:48:09.923697 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-67f81411-690c-4218-9070-dbe2d045d20e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Returning 404 to user: Instance a8693cb4-e6b1-4956-a996-04effeb71f79 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:48:09.924536 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-67f81411-690c-4218-9070-dbe2d045d20e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 404 len: 111 microversion: 2.1 time: 0.091627 Dec 16 14:48:09.925111 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 501/1029] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:48:09 2021] DELETE /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:48:09.942103 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9ecb9f57-afcf-44df-bfc4-239783b27c72 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:09.942103 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9ecb9f57-afcf-44df-bfc4-239783b27c72 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: a8693cb4-e6b1-4956-a996-04effeb71f79] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:09.952123 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ecb9f57-afcf-44df-bfc4-239783b27c72 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:09.952563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ecb9f57-afcf-44df-bfc4-239783b27c72 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:09.953368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ecb9f57-afcf-44df-bfc4-239783b27c72 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:09.953791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9ecb9f57-afcf-44df-bfc4-239783b27c72 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:10.006656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-9ecb9f57-afcf-44df-bfc4-239783b27c72 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] HTTP exception thrown: Instance a8693cb4-e6b1-4956-a996-04effeb71f79 could not be found. Dec 16 14:48:10.007260 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9ecb9f57-afcf-44df-bfc4-239783b27c72 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Returning 404 to user: Instance a8693cb4-e6b1-4956-a996-04effeb71f79 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:48:10.008086 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9ecb9f57-afcf-44df-bfc4-239783b27c72 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79" status: 404 len: 111 microversion: 2.1 time: 0.078580 Dec 16 14:48:10.008670 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 529/1030] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:09 2021] GET /compute/v2.1/servers/a8693cb4-e6b1-4956-a996-04effeb71f79 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:48:10.010089 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:10.010879 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:10.023689 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:10.024428 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:10.025982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:10.026732 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:10.311940 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:10.326022 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:10.332580 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:10.333708 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-165ea245-bb0a-4d34-9d1b-a0228dd57f7e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1745 microversion: 2.20 time: 0.334249 Dec 16 14:48:10.334286 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 502/1031] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:09 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1745 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:11.366525 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:11.367466 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:11.378611 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:11.379056 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:11.379834 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:11.380258 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:11.382671 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-88dd4717-c014-4c86-83d8-56c0b4bda1a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:11.383184 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-88dd4717-c014-4c86-83d8-56c0b4bda1a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:11.392185 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-88dd4717-c014-4c86-83d8-56c0b4bda1a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:11.392622 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-88dd4717-c014-4c86-83d8-56c0b4bda1a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:11.393417 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-88dd4717-c014-4c86-83d8-56c0b4bda1a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:11.393852 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-88dd4717-c014-4c86-83d8-56c0b4bda1a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:11.450609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-88dd4717-c014-4c86-83d8-56c0b4bda1a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] HTTP exception thrown: Instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa could not be found. Dec 16 14:48:11.451834 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-88dd4717-c014-4c86-83d8-56c0b4bda1a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Returning 404 to user: Instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:48:11.452681 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-88dd4717-c014-4c86-83d8-56c0b4bda1a9 tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 404 len: 111 microversion: 2.1 time: 0.079289 Dec 16 14:48:11.453229 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 503/1032] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:48:11 2021] DELETE /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:48:11.467429 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ba7d3fb8-45cd-47ec-8f50-1d7140df806e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:11.468156 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ba7d3fb8-45cd-47ec-8f50-1d7140df806e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] [instance: 7d728139-ef79-4b38-b489-6fd9aa84d0fa] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:11.476358 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba7d3fb8-45cd-47ec-8f50-1d7140df806e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:11.476801 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba7d3fb8-45cd-47ec-8f50-1d7140df806e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:11.477597 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba7d3fb8-45cd-47ec-8f50-1d7140df806e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:11.478048 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ba7d3fb8-45cd-47ec-8f50-1d7140df806e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:11.532548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-ba7d3fb8-45cd-47ec-8f50-1d7140df806e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] HTTP exception thrown: Instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa could not be found. Dec 16 14:48:11.533150 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ba7d3fb8-45cd-47ec-8f50-1d7140df806e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] Returning 404 to user: Instance 7d728139-ef79-4b38-b489-6fd9aa84d0fa could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:48:11.533962 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ba7d3fb8-45cd-47ec-8f50-1d7140df806e tempest-AttachVolumeTestJSON-1639731338 tempest-AttachVolumeTestJSON-1639731338-project] 10.222.0.67 "GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa" status: 404 len: 111 microversion: 2.1 time: 0.076099 Dec 16 14:48:11.534550 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 504/1033] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:11 2021] GET /compute/v2.1/servers/7d728139-ef79-4b38-b489-6fd9aa84d0fa => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:48:11.647214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:11.665148 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:11.672482 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:11.673678 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-09b1818f-1c79-4b52-a66c-69a7c8eab424 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1745 microversion: 2.20 time: 0.324432 Dec 16 14:48:11.674282 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 530/1034] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:11 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1745 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:48:12.699133 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:12.699967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:12.708633 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:12.709784 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:12.710841 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:12.711537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:12.883409 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-9e46f35b-0f18-4466-8e45-0158236ef03e req-e4a4436b-7bd0-42cd-824a-2eb89768e390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd517a0-bd8a-4e52-93ac-304678993d24", "name": "network-vif-plugged", "status": "completed", "tag": "89eb0392-5a52-4cad-8793-177f104836c0"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:12.891922 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:48:12.891922 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:48:12.900736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-9e46f35b-0f18-4466-8e45-0158236ef03e req-e4a4436b-7bd0-42cd-824a-2eb89768e390 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:12.901219 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-9e46f35b-0f18-4466-8e45-0158236ef03e req-e4a4436b-7bd0-42cd-824a-2eb89768e390 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:12.919947 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-9e46f35b-0f18-4466-8e45-0158236ef03e req-e4a4436b-7bd0-42cd-824a-2eb89768e390 service nova] Creating event network-vif-plugged:89eb0392-5a52-4cad-8793-177f104836c0 for instance 1bd517a0-bd8a-4e52-93ac-304678993d24 on hv-cinder-82189 Dec 16 14:48:12.925815 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-9e46f35b-0f18-4466-8e45-0158236ef03e req-e4a4436b-7bd0-42cd-824a-2eb89768e390 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055713 Dec 16 14:48:12.926948 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 531/1035] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:48:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:13.041957 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:13.057809 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:13.065326 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:13.066555 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-95bcdfce-6adb-4e07-ab1b-150c3922e163 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1745 microversion: 2.20 time: 0.377258 Dec 16 14:48:13.067119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 505/1036] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:12 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1745 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:14.095576 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:14.097205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:14.111182 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:14.112398 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:14.114189 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:14.115638 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:14.400094 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:14.415616 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:14.423190 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:14.424365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-669faf32-710c-49de-a818-1c9696660210 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1745 microversion: 2.20 time: 0.342657 Dec 16 14:48:14.425088 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 532/1037] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:14 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1745 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:48:15.453665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:15.456111 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:15.473789 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:15.475008 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:15.476828 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:15.478048 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:16.106757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:16.136361 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:16.146313 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:16.148371 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-027e6bdc-3afc-47e6-af0d-ab05e56cd029 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.705315 Dec 16 14:48:16.149330 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 506/1038] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:15 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:17.186952 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:17.188267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:17.200635 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:17.201419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:17.202488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:17.202930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:17.536802 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:17.572798 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:17.591272 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:17.594085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a49517f9-63e3-41e1-b4a6-480e2602cf97 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.417099 Dec 16 14:48:17.622045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 533/1039] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:17 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:18.651982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:18.652951 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:18.663320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:18.664206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:18.665315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:18.666092 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:19.057973 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:19.088830 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:19.104347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:19.107115 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ef80d6a1-fcb7-4396-b1c1-5ba72ccbe0b4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.471231 Dec 16 14:48:19.108984 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 507/1040] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:18 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:20.133830 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:20.135806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:20.156869 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:20.157944 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:20.184474 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:20.187354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:20.610963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:20.648148 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:20.662599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:20.665717 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2e2aaaab-624e-421a-8e0f-08bbedc143a5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.541037 Dec 16 14:48:20.682780 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 534/1041] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:20 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:21.703482 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:21.705190 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:21.720687 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:21.725404 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:21.727361 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:21.728526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:22.141549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:22.173912 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:22.189589 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:22.192662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cf1d291a-453e-4229-a4e1-a9187542282c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.507062 Dec 16 14:48:22.207164 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 508/1042] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:21 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:23.228769 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:23.231633 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:23.238248 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:23.238745 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:23.239672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:23.240091 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:23.498221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:23.534445 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:23.544310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:23.546525 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4d9ed4f9-dff3-4dda-b1cb-b3abcb69059f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.327355 Dec 16 14:48:23.559672 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 535/1043] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:23 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:24.586630 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:24.589318 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:24.613490 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:24.614858 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:24.617316 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:24.618519 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:24.662814 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1496342833", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "networks": [{"uuid": "32e1bc01-b84b-4784-8fab-5e9379c8e7dd"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:24.744761 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] validate_networks() for [('32e1bc01-b84b-4784-8fab-5e9379c8e7dd', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:48:25.059825 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:25.088603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:25.103285 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:25.105866 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8219d156-af5a-4995-bf34-24ae9e65fb63 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.542669 Dec 16 14:48:25.110062 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 536/1044] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:24 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:48:25.525009 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:48:25.526265 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:48:25.528290 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:48:25.529853 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:48:25.531392 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:48:25.549140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:25.551536 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:25.554044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:25.555491 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:25.603271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Getting quotas for project eb6df6b44f0d42339c2fd1095ce3bdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:48:25.610331 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Getting quotas for user 9a05ec0df9334b0ca96bffdd9fdfe99d and project eb6df6b44f0d42339c2fd1095ce3bdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:48:25.628380 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:48:25.634809 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:48:25.705763 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e888ea63-eefd-44e1-a277-eff7685c30c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.412701 Dec 16 14:48:25.706909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 509/1045] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:48:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:48:25.727419 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0f96fd5b-5fee-4a19-8861-d7a11bf3a72b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:25.730013 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0f96fd5b-5fee-4a19-8861-d7a11bf3a72b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:25.825696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0f96fd5b-5fee-4a19-8861-d7a11bf3a72b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:25.839300 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0f96fd5b-5fee-4a19-8861-d7a11bf3a72b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1218 microversion: 2.1 time: 0.126405 Dec 16 14:48:25.848854 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 537/1046] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:25 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:26.139898 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:26.142024 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:26.170082 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:26.171050 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:26.173639 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:26.174753 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:26.707352 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:26.729320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:26.742762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:26.743856 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e4711079-3163-42cd-8d10-61dc823ff484 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.622391 Dec 16 14:48:26.745019 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 510/1047] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:26 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:48:26.863989 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e4fdcac1-8573-46ea-9314-745a21f4ed35 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:26.864702 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e4fdcac1-8573-46ea-9314-745a21f4ed35 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:26.874633 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4fdcac1-8573-46ea-9314-745a21f4ed35 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:26.875346 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4fdcac1-8573-46ea-9314-745a21f4ed35 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:26.876780 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4fdcac1-8573-46ea-9314-745a21f4ed35 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:26.877695 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4fdcac1-8573-46ea-9314-745a21f4ed35 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:27.055872 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e4fdcac1-8573-46ea-9314-745a21f4ed35 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:27.075877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e4fdcac1-8573-46ea-9314-745a21f4ed35 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1270 microversion: 2.1 time: 0.222226 Dec 16 14:48:27.079524 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 538/1048] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:26 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:27.779588 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:27.782096 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:27.797013 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:27.798858 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:27.800556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:27.801178 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:28.101451 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:28.125626 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bc804151-7667-4c95-93c8-a092cb92438f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:28.127000 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-bc804151-7667-4c95-93c8-a092cb92438f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:28.135303 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bc804151-7667-4c95-93c8-a092cb92438f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:28.136076 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bc804151-7667-4c95-93c8-a092cb92438f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:28.137032 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bc804151-7667-4c95-93c8-a092cb92438f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:28.137607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bc804151-7667-4c95-93c8-a092cb92438f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:28.149022 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:28.165777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:28.169289 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a91ee6cc-5acd-441b-8d1b-b0654d6c3078 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.404832 Dec 16 14:48:28.170459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 511/1049] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:27 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:28.300344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bc804151-7667-4c95-93c8-a092cb92438f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:28.315920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-bc804151-7667-4c95-93c8-a092cb92438f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1276 microversion: 2.1 time: 0.217475 Dec 16 14:48:28.316569 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 539/1050] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:28 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:29.195424 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:29.196190 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:29.204964 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:29.205569 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:29.206504 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:29.207070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:29.338943 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-69770a9c-f5fe-46cb-9217-2e3455d239ae tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:29.339692 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-69770a9c-f5fe-46cb-9217-2e3455d239ae tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:29.348657 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-69770a9c-f5fe-46cb-9217-2e3455d239ae tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:29.349275 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-69770a9c-f5fe-46cb-9217-2e3455d239ae tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:29.350247 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-69770a9c-f5fe-46cb-9217-2e3455d239ae tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:29.350782 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-69770a9c-f5fe-46cb-9217-2e3455d239ae tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:29.516533 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:29.532147 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:29.538962 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:29.540135 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-58e07633-f380-402a-b9bb-1c2cd33ee6e6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1740 microversion: 2.20 time: 0.355237 Dec 16 14:48:29.540685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 512/1051] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:29 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:30.010346 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-69770a9c-f5fe-46cb-9217-2e3455d239ae tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:30.027636 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-69770a9c-f5fe-46cb-9217-2e3455d239ae tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.697851 Dec 16 14:48:30.028574 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 540/1052] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:29 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:30.242226 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-0d2a8dc2-abf7-45d9-91bc-dea4ee92d078 req-1b3fdcaa-fcbf-4105-8a4a-f3310bf44648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce2c4de-519d-4a42-924e-5e221538f9a7", "tag": "4372c3e3-9edf-4ff8-a0ec-5eff7b96066a"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:30.249441 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:48:30.249441 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:48:30.260403 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-0d2a8dc2-abf7-45d9-91bc-dea4ee92d078 req-1b3fdcaa-fcbf-4105-8a4a-f3310bf44648 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:30.260942 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-0d2a8dc2-abf7-45d9-91bc-dea4ee92d078 req-1b3fdcaa-fcbf-4105-8a4a-f3310bf44648 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:30.282329 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-0d2a8dc2-abf7-45d9-91bc-dea4ee92d078 req-1b3fdcaa-fcbf-4105-8a4a-f3310bf44648 service nova] Creating event network-changed:4372c3e3-9edf-4ff8-a0ec-5eff7b96066a for instance dce2c4de-519d-4a42-924e-5e221538f9a7 on hv-cinder-82189 Dec 16 14:48:30.287516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-0d2a8dc2-abf7-45d9-91bc-dea4ee92d078 req-1b3fdcaa-fcbf-4105-8a4a-f3310bf44648 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063835 Dec 16 14:48:30.288138 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 513/1053] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:48:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:30.581711 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:30.582464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:30.598703 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:30.599342 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:30.600457 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:30.600949 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:30.996749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:31.011423 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:31.018847 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:31.020042 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b57043f0-d5e6-4e2a-a24e-31aa9b7f96aa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1722 microversion: 2.20 time: 0.448599 Dec 16 14:48:31.020574 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 541/1054] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:30 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:31.052043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1ee63811-82e6-43bb-b6ff-583db78c7aec tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:31.052738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1ee63811-82e6-43bb-b6ff-583db78c7aec tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:31.062892 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1ee63811-82e6-43bb-b6ff-583db78c7aec tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:31.063803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1ee63811-82e6-43bb-b6ff-583db78c7aec tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:31.065565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1ee63811-82e6-43bb-b6ff-583db78c7aec tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:31.066363 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1ee63811-82e6-43bb-b6ff-583db78c7aec tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:31.410843 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1ee63811-82e6-43bb-b6ff-583db78c7aec tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:31.421130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1ee63811-82e6-43bb-b6ff-583db78c7aec tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.379389 Dec 16 14:48:31.421834 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 514/1055] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:31 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:32.045228 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:32.045866 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:32.054746 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:32.055224 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:32.056243 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:32.056712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:32.273273 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:32.287572 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:32.293735 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:32.294884 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-91a2ea8b-6dd8-44ce-9617-4ea612101062 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1722 microversion: 2.20 time: 0.259700 Dec 16 14:48:32.295418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 542/1056] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:32 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:32.444034 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d891f22a-1664-41aa-b34f-a9f8c1bb3197 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:32.444897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d891f22a-1664-41aa-b34f-a9f8c1bb3197 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:32.452485 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d891f22a-1664-41aa-b34f-a9f8c1bb3197 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:32.453553 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d891f22a-1664-41aa-b34f-a9f8c1bb3197 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:32.454386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d891f22a-1664-41aa-b34f-a9f8c1bb3197 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:32.454809 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d891f22a-1664-41aa-b34f-a9f8c1bb3197 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:32.662190 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d891f22a-1664-41aa-b34f-a9f8c1bb3197 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:32.673922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d891f22a-1664-41aa-b34f-a9f8c1bb3197 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.240021 Dec 16 14:48:32.674548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 515/1057] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:32 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:33.319633 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:33.320424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:33.329900 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:33.330354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:33.331365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:33.331797 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:33.563962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:33.578276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:33.584680 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:33.585878 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6c33dcdc-b385-4280-b4f3-4c6fde3aca86 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1725 microversion: 2.20 time: 0.276277 Dec 16 14:48:33.586458 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 543/1058] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:33 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:33.610483 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-be03d3bf-addc-4361-b1e7-6a6f6dfc52b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78453c8e-2e0f-48ec-a984-21c69f34cd9b"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:33.611558 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-be03d3bf-addc-4361-b1e7-6a6f6dfc52b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:33.618988 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be03d3bf-addc-4361-b1e7-6a6f6dfc52b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:33.619422 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be03d3bf-addc-4361-b1e7-6a6f6dfc52b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:33.620210 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be03d3bf-addc-4361-b1e7-6a6f6dfc52b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:33.620627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be03d3bf-addc-4361-b1e7-6a6f6dfc52b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:33.697373 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ea80b38f-b32f-49a7-84fc-181c0e33950e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:33.697959 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ea80b38f-b32f-49a7-84fc-181c0e33950e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:33.708278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea80b38f-b32f-49a7-84fc-181c0e33950e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:33.708735 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea80b38f-b32f-49a7-84fc-181c0e33950e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:33.709534 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea80b38f-b32f-49a7-84fc-181c0e33950e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:33.709944 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea80b38f-b32f-49a7-84fc-181c0e33950e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:33.931703 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ea80b38f-b32f-49a7-84fc-181c0e33950e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:33.941146 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ea80b38f-b32f-49a7-84fc-181c0e33950e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.253670 Dec 16 14:48:33.941803 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 544/1059] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:33 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:34.103787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-be03d3bf-addc-4361-b1e7-6a6f6dfc52b0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.503220 Dec 16 14:48:34.104392 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 516/1060] 10.222.0.67 () {62 vars in 1363 bytes} [Thu Dec 16 14:48:33 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/os-volume_attachments => generated 188 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:34.320017 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8bba40f5-1b8f-45b4-86f2-852bd7f83c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:34.320613 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8bba40f5-1b8f-45b4-86f2-852bd7f83c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:34.328910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8bba40f5-1b8f-45b4-86f2-852bd7f83c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:34.329336 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8bba40f5-1b8f-45b4-86f2-852bd7f83c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:34.330195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8bba40f5-1b8f-45b4-86f2-852bd7f83c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:34.330617 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8bba40f5-1b8f-45b4-86f2-852bd7f83c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:34.826895 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8bba40f5-1b8f-45b4-86f2-852bd7f83c2e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/os-volume_attachments/78453c8e-2e0f-48ec-a984-21c69f34cd9b" status: 202 len: 0 microversion: 2.20 time: 0.516522 Dec 16 14:48:34.827677 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 545/1061] 10.222.0.67 () {60 vars in 1456 bytes} [Thu Dec 16 14:48:34 2021] DELETE /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/os-volume_attachments/78453c8e-2e0f-48ec-a984-21c69f34cd9b => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:48:34.943782 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-45eab897-1b33-4944-8466-f472287d24fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:34.945100 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-45eab897-1b33-4944-8466-f472287d24fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:34.954890 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-45eab897-1b33-4944-8466-f472287d24fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:34.955822 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-45eab897-1b33-4944-8466-f472287d24fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:34.956934 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-45eab897-1b33-4944-8466-f472287d24fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:34.957643 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-45eab897-1b33-4944-8466-f472287d24fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:34.965244 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-99c57601-5c32-4f8f-9a34-01c38df213bf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:34.965975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-99c57601-5c32-4f8f-9a34-01c38df213bf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:34.978436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99c57601-5c32-4f8f-9a34-01c38df213bf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:34.978882 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99c57601-5c32-4f8f-9a34-01c38df213bf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:34.979876 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99c57601-5c32-4f8f-9a34-01c38df213bf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:34.980475 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-99c57601-5c32-4f8f-9a34-01c38df213bf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:35.235925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-45eab897-1b33-4944-8466-f472287d24fa tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action" status: 202 len: 0 microversion: 2.20 time: 0.303028 Dec 16 14:48:35.236559 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 517/1062] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Dec 16 14:48:34 2021] POST /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:48:35.247876 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-37cd7d04-b678-4459-9f03-25397aa11d27 req-77bd7953-e9e0-4dcf-a085-0ddfa3abf498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd517a0-bd8a-4e52-93ac-304678993d24", "name": "network-vif-unplugged", "status": "completed", "tag": "89eb0392-5a52-4cad-8793-177f104836c0"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:35.256140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:48:35.256140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:48:35.267424 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-37cd7d04-b678-4459-9f03-25397aa11d27 req-77bd7953-e9e0-4dcf-a085-0ddfa3abf498 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:35.268764 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-37cd7d04-b678-4459-9f03-25397aa11d27 req-77bd7953-e9e0-4dcf-a085-0ddfa3abf498 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:35.290580 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.compute.server_external_events [req-37cd7d04-b678-4459-9f03-25397aa11d27 req-77bd7953-e9e0-4dcf-a085-0ddfa3abf498 service nova] Unable to find a host for instance 1bd517a0-bd8a-4e52-93ac-304678993d24. Dropping event network-vif-unplugged {{(pid=96669) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 16 14:48:35.291720 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-37cd7d04-b678-4459-9f03-25397aa11d27 req-77bd7953-e9e0-4dcf-a085-0ddfa3abf498 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054138 Dec 16 14:48:35.292509 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 518/1063] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:48:35 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 16 14:48:35.303474 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:35.304430 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:35.312658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:35.313402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:35.314434 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:35.315027 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:35.617939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-99c57601-5c32-4f8f-9a34-01c38df213bf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:35.627359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-99c57601-5c32-4f8f-9a34-01c38df213bf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.672129 Dec 16 14:48:35.627655 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 546/1064] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:34 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:35.782552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:35.797208 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:35.803665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:35.805068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ab06a0b3-1740-4784-9fb7-870ca64e19f0 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1673 microversion: 2.20 time: 0.511462 Dec 16 14:48:35.805920 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 519/1065] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:35 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1673 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:36.650912 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3d9ad965-2069-4ec0-ade1-ec02585bba6f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:36.651575 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3d9ad965-2069-4ec0-ade1-ec02585bba6f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:36.659847 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3d9ad965-2069-4ec0-ade1-ec02585bba6f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:36.660267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3d9ad965-2069-4ec0-ade1-ec02585bba6f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:36.661096 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3d9ad965-2069-4ec0-ade1-ec02585bba6f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:36.661529 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3d9ad965-2069-4ec0-ade1-ec02585bba6f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:36.835377 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:36.836546 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:36.845119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:36.845544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:36.846593 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:36.847050 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:37.052436 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:37.067565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:37.074068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:37.075212 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5bddfb36-1ed7-4d39-b9bf-bf78059b3260 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1675 microversion: 2.20 time: 0.250964 Dec 16 14:48:37.075752 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 520/1066] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:36 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1675 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:37.149442 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3d9ad965-2069-4ec0-ade1-ec02585bba6f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:37.159029 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3d9ad965-2069-4ec0-ade1-ec02585bba6f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.517295 Dec 16 14:48:37.159831 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 547/1067] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:36 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:37.311772 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-553bf6dc-f6dc-4027-86cb-d72be7bcabeb tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:37.312665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-553bf6dc-f6dc-4027-86cb-d72be7bcabeb tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:37.320721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-553bf6dc-f6dc-4027-86cb-d72be7bcabeb tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:37.321454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-553bf6dc-f6dc-4027-86cb-d72be7bcabeb tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:37.322481 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-553bf6dc-f6dc-4027-86cb-d72be7bcabeb tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:37.323060 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-553bf6dc-f6dc-4027-86cb-d72be7bcabeb tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:37.335901 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-03697caf-c82b-4fa1-b6bf-3d98c22d1553 req-7393bafe-8e05-4c80-8041-653e6dd77233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6e43c8-eea5-48d0-b7bf-ff18381a0f20", "tag": "a1de2547-6459-4d87-9d1f-a9adfc216809"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:37.353440 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:48:37.353440 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:48:37.374997 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-03697caf-c82b-4fa1-b6bf-3d98c22d1553 req-7393bafe-8e05-4c80-8041-653e6dd77233 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:37.376009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-03697caf-c82b-4fa1-b6bf-3d98c22d1553 req-7393bafe-8e05-4c80-8041-653e6dd77233 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:37.397917 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-553bf6dc-f6dc-4027-86cb-d72be7bcabeb tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:48:37.426823 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-03697caf-c82b-4fa1-b6bf-3d98c22d1553 req-7393bafe-8e05-4c80-8041-653e6dd77233 service nova] Creating event network-changed:a1de2547-6459-4d87-9d1f-a9adfc216809 for instance fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 on hv-cinder-82189 Dec 16 14:48:37.432123 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-03697caf-c82b-4fa1-b6bf-3d98c22d1553 req-7393bafe-8e05-4c80-8041-653e6dd77233 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123839 Dec 16 14:48:37.433234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 548/1068] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:48:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:37.572366 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-553bf6dc-f6dc-4027-86cb-d72be7bcabeb tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 204 len: 0 microversion: 2.1 time: 0.269252 Dec 16 14:48:37.573452 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 521/1069] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:48:37 2021] DELETE /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:48:37.600713 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ba7bbd2c-56da-4ed2-a468-9dea9a92eade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:37.602807 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ba7bbd2c-56da-4ed2-a468-9dea9a92eade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:37.618335 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ba7bbd2c-56da-4ed2-a468-9dea9a92eade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:37.619150 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ba7bbd2c-56da-4ed2-a468-9dea9a92eade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:37.620477 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ba7bbd2c-56da-4ed2-a468-9dea9a92eade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:37.621324 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ba7bbd2c-56da-4ed2-a468-9dea9a92eade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:37.968453 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ba7bbd2c-56da-4ed2-a468-9dea9a92eade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:37.980490 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ba7bbd2c-56da-4ed2-a468-9dea9a92eade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1566 microversion: 2.1 time: 0.401696 Dec 16 14:48:37.981286 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 549/1070] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:37 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1566 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:38.104406 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:38.105234 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:38.114341 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:38.114926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:38.115933 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:38.116438 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:38.185245 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6a9b2f1e-54d0-4b4e-bcff-824d8fd47090 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:38.189271 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6a9b2f1e-54d0-4b4e-bcff-824d8fd47090 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:38.210440 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a9b2f1e-54d0-4b4e-bcff-824d8fd47090 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:38.210841 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a9b2f1e-54d0-4b4e-bcff-824d8fd47090 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:38.211743 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a9b2f1e-54d0-4b4e-bcff-824d8fd47090 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:38.212089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-6a9b2f1e-54d0-4b4e-bcff-824d8fd47090 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:38.597671 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:38.634932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:38.647228 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6a9b2f1e-54d0-4b4e-bcff-824d8fd47090 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:38.647594 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:38.648819 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-17ed0d36-2ada-4a6b-8eac-d74a33bed3c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.557255 Dec 16 14:48:38.649756 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 522/1071] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:38 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:38.656514 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6a9b2f1e-54d0-4b4e-bcff-824d8fd47090 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.482903 Dec 16 14:48:38.657362 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 550/1072] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:38 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:39.006998 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-56a39507-bf00-441f-8e00-736f3e7417c0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:39.008011 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-56a39507-bf00-441f-8e00-736f3e7417c0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:39.033818 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-56a39507-bf00-441f-8e00-736f3e7417c0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.034522 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-56a39507-bf00-441f-8e00-736f3e7417c0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:39.041397 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-56a39507-bf00-441f-8e00-736f3e7417c0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.042180 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-56a39507-bf00-441f-8e00-736f3e7417c0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:39.206416 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-4302a626-1470-4c1b-97ee-42bb4c7d36f4 req-ea820681-8383-4bea-b894-a4728be03826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce2c4de-519d-4a42-924e-5e221538f9a7", "name": "network-vif-plugged", "status": "completed", "tag": "4372c3e3-9edf-4ff8-a0ec-5eff7b96066a"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:39.229258 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:48:39.229258 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:48:39.260435 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-4302a626-1470-4c1b-97ee-42bb4c7d36f4 req-ea820681-8383-4bea-b894-a4728be03826 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.260738 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-4302a626-1470-4c1b-97ee-42bb4c7d36f4 req-ea820681-8383-4bea-b894-a4728be03826 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:39.301434 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-4302a626-1470-4c1b-97ee-42bb4c7d36f4 req-ea820681-8383-4bea-b894-a4728be03826 service nova] Creating event network-vif-plugged:4372c3e3-9edf-4ff8-a0ec-5eff7b96066a for instance dce2c4de-519d-4a42-924e-5e221538f9a7 on hv-cinder-82189 Dec 16 14:48:39.308705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-4302a626-1470-4c1b-97ee-42bb4c7d36f4 req-ea820681-8383-4bea-b894-a4728be03826 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115665 Dec 16 14:48:39.310017 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 551/1073] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:48:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:48:39.559000 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-56a39507-bf00-441f-8e00-736f3e7417c0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:39.573358 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-56a39507-bf00-441f-8e00-736f3e7417c0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.578254 Dec 16 14:48:39.575699 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 523/1074] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:38 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:39.690673 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3aecb3a9-e068-423a-b68e-86264988270a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:39.692273 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3aecb3a9-e068-423a-b68e-86264988270a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:39.695313 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:39.696695 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:39.703177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3aecb3a9-e068-423a-b68e-86264988270a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.704454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3aecb3a9-e068-423a-b68e-86264988270a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:39.705594 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3aecb3a9-e068-423a-b68e-86264988270a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.709345 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3aecb3a9-e068-423a-b68e-86264988270a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:39.709832 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.710656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:39.711457 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.711890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:39.967483 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3aecb3a9-e068-423a-b68e-86264988270a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:39.976886 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3aecb3a9-e068-423a-b68e-86264988270a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.304498 Dec 16 14:48:39.985531 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:39.990280 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 524/1075] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:39 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:40.001380 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:40.008301 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:40.009517 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e1e43673-7183-4113-a4b4-665920801e5a tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.337122 Dec 16 14:48:40.010394 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 552/1076] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:39 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:40.597632 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-630bca2d-c5b4-4b03-bea0-a980a05c95a2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:40.598350 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-630bca2d-c5b4-4b03-bea0-a980a05c95a2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:40.607185 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-630bca2d-c5b4-4b03-bea0-a980a05c95a2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:40.607894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-630bca2d-c5b4-4b03-bea0-a980a05c95a2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:40.608805 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-630bca2d-c5b4-4b03-bea0-a980a05c95a2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:40.610409 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-630bca2d-c5b4-4b03-bea0-a980a05c95a2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:40.864106 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-630bca2d-c5b4-4b03-bea0-a980a05c95a2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:40.875049 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-630bca2d-c5b4-4b03-bea0-a980a05c95a2 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.287462 Dec 16 14:48:40.876220 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 525/1077] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:40 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:41.002478 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8b72af25-e330-4d44-bb28-0b21297516bb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:41.003086 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8b72af25-e330-4d44-bb28-0b21297516bb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:41.011353 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b72af25-e330-4d44-bb28-0b21297516bb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:41.011794 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b72af25-e330-4d44-bb28-0b21297516bb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:41.012570 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b72af25-e330-4d44-bb28-0b21297516bb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:41.012993 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8b72af25-e330-4d44-bb28-0b21297516bb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:41.036743 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:41.038097 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:41.052031 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:41.052880 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:41.054429 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:41.055282 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:41.326431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8b72af25-e330-4d44-bb28-0b21297516bb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:41.336525 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8b72af25-e330-4d44-bb28-0b21297516bb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.344725 Dec 16 14:48:41.344375 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 553/1078] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:40 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:41.428126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:41.446726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:41.453243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:41.454432 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-58757265-8059-4ccc-a358-cf70058f518c tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.428731 Dec 16 14:48:41.462942 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 526/1079] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:41 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:48:41.898011 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5029467d-f1da-477c-9169-5a354172d9e9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:41.898616 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5029467d-f1da-477c-9169-5a354172d9e9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:41.908053 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5029467d-f1da-477c-9169-5a354172d9e9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:41.908485 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5029467d-f1da-477c-9169-5a354172d9e9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:41.909325 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5029467d-f1da-477c-9169-5a354172d9e9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:41.909708 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5029467d-f1da-477c-9169-5a354172d9e9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:42.191644 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5029467d-f1da-477c-9169-5a354172d9e9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:42.206309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5029467d-f1da-477c-9169-5a354172d9e9 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.318147 Dec 16 14:48:42.206912 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 554/1080] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:41 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:42.361658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ca53232f-617c-4624-9861-b42b5f2b5d90 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:42.362362 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ca53232f-617c-4624-9861-b42b5f2b5d90 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:42.370955 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ca53232f-617c-4624-9861-b42b5f2b5d90 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:42.371445 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ca53232f-617c-4624-9861-b42b5f2b5d90 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:42.372432 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ca53232f-617c-4624-9861-b42b5f2b5d90 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:42.372980 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ca53232f-617c-4624-9861-b42b5f2b5d90 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:42.482877 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:42.483440 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:42.493369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:42.494034 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:42.494858 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:42.495291 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:42.647898 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ca53232f-617c-4624-9861-b42b5f2b5d90 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:42.668747 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ca53232f-617c-4624-9861-b42b5f2b5d90 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.317214 Dec 16 14:48:42.670181 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 527/1081] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:42 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:42.743515 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:42.759592 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:42.767149 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:42.768348 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9d8fab44-43fa-4d63-b142-1551f5685fe8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.298899 Dec 16 14:48:42.769135 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 555/1082] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:42 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:43.231231 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-391f8a4d-4def-498c-9054-804c0b8b7041 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:43.231945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-391f8a4d-4def-498c-9054-804c0b8b7041 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:43.240592 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-391f8a4d-4def-498c-9054-804c0b8b7041 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:43.241029 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-391f8a4d-4def-498c-9054-804c0b8b7041 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:43.241819 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-391f8a4d-4def-498c-9054-804c0b8b7041 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:43.242283 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-391f8a4d-4def-498c-9054-804c0b8b7041 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:43.474902 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-391f8a4d-4def-498c-9054-804c0b8b7041 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:43.484055 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-391f8a4d-4def-498c-9054-804c0b8b7041 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.262876 Dec 16 14:48:43.485599 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 528/1083] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:43 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:43.701003 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4dfa9f71-7b17-4382-8bdd-a8d1ca7a4deb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:43.701705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4dfa9f71-7b17-4382-8bdd-a8d1ca7a4deb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:43.710349 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dfa9f71-7b17-4382-8bdd-a8d1ca7a4deb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:43.710618 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dfa9f71-7b17-4382-8bdd-a8d1ca7a4deb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:43.711242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dfa9f71-7b17-4382-8bdd-a8d1ca7a4deb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:43.711674 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4dfa9f71-7b17-4382-8bdd-a8d1ca7a4deb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:43.793002 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:43.793479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:43.801540 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:43.802026 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:43.802974 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:43.804337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:43.957512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4dfa9f71-7b17-4382-8bdd-a8d1ca7a4deb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:43.981896 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4dfa9f71-7b17-4382-8bdd-a8d1ca7a4deb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.290216 Dec 16 14:48:43.982514 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 556/1084] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:43 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:44.069692 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:44.085093 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:44.091747 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:44.092974 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-bc1841d2-141a-43c2-bc9a-12e7a5ab3054 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.309680 Dec 16 14:48:44.093471 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 529/1085] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:43 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:48:44.507549 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d12bdf0c-7ac1-4f27-8637-8322ac59ff3b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:44.508157 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d12bdf0c-7ac1-4f27-8637-8322ac59ff3b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:44.517269 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d12bdf0c-7ac1-4f27-8637-8322ac59ff3b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:44.517724 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d12bdf0c-7ac1-4f27-8637-8322ac59ff3b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:44.518563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d12bdf0c-7ac1-4f27-8637-8322ac59ff3b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:44.519000 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d12bdf0c-7ac1-4f27-8637-8322ac59ff3b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:44.742822 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d12bdf0c-7ac1-4f27-8637-8322ac59ff3b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:44.752061 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d12bdf0c-7ac1-4f27-8637-8322ac59ff3b tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.254349 Dec 16 14:48:44.752787 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 557/1086] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:44 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:45.017629 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e63979d7-d0d5-4cbf-a91d-d0f3446adde6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:45.018373 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e63979d7-d0d5-4cbf-a91d-d0f3446adde6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:45.026334 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e63979d7-d0d5-4cbf-a91d-d0f3446adde6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:45.026857 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e63979d7-d0d5-4cbf-a91d-d0f3446adde6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:45.027718 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e63979d7-d0d5-4cbf-a91d-d0f3446adde6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:45.028203 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e63979d7-d0d5-4cbf-a91d-d0f3446adde6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:45.126938 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:45.127544 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:45.136156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:45.136598 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:45.137369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:45.137787 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:45.297548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e63979d7-d0d5-4cbf-a91d-d0f3446adde6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:45.306934 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e63979d7-d0d5-4cbf-a91d-d0f3446adde6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.299232 Dec 16 14:48:45.307556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 530/1087] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:45 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:45.396736 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:45.416965 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:45.424413 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:45.425568 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9accd256-9f9b-4f70-9453-5608b6d7e2a7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.309120 Dec 16 14:48:45.426511 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 558/1088] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:45 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:45.790187 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2febfb92-6236-48ca-a665-0640fa576ade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:45.790973 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2febfb92-6236-48ca-a665-0640fa576ade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:45.802005 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2febfb92-6236-48ca-a665-0640fa576ade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:45.802737 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2febfb92-6236-48ca-a665-0640fa576ade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:45.803619 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2febfb92-6236-48ca-a665-0640fa576ade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:45.804440 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2febfb92-6236-48ca-a665-0640fa576ade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:46.058793 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2febfb92-6236-48ca-a665-0640fa576ade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:46.072378 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2febfb92-6236-48ca-a665-0640fa576ade tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.305084 Dec 16 14:48:46.072937 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 531/1089] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:45 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:46.330523 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2e5fdf9e-4592-4a1c-aa0b-5ec66bc358d4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:46.331212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2e5fdf9e-4592-4a1c-aa0b-5ec66bc358d4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:46.339477 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2e5fdf9e-4592-4a1c-aa0b-5ec66bc358d4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:46.339910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2e5fdf9e-4592-4a1c-aa0b-5ec66bc358d4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:46.340797 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2e5fdf9e-4592-4a1c-aa0b-5ec66bc358d4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:46.341299 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2e5fdf9e-4592-4a1c-aa0b-5ec66bc358d4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:46.452451 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:46.453099 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:46.461808 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:46.462296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:46.463108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:46.463537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:46.610763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2e5fdf9e-4592-4a1c-aa0b-5ec66bc358d4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:46.624287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2e5fdf9e-4592-4a1c-aa0b-5ec66bc358d4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.304082 Dec 16 14:48:46.625219 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 559/1090] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:46 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:46.713650 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:46.740984 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:46.747665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:46.748823 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7b832e03-cdf8-4feb-b4d3-d60666204717 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.308002 Dec 16 14:48:46.749390 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 532/1091] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:46 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:47.095222 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b188eeff-2e0c-445e-bdf0-25339d29396d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:47.095967 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b188eeff-2e0c-445e-bdf0-25339d29396d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:47.105235 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b188eeff-2e0c-445e-bdf0-25339d29396d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:47.105767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b188eeff-2e0c-445e-bdf0-25339d29396d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:47.106662 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b188eeff-2e0c-445e-bdf0-25339d29396d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:47.107156 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b188eeff-2e0c-445e-bdf0-25339d29396d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:47.349650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b188eeff-2e0c-445e-bdf0-25339d29396d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:47.359437 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b188eeff-2e0c-445e-bdf0-25339d29396d tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.274083 Dec 16 14:48:47.360581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 560/1092] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:47 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:47.648476 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0d85dc80-b196-4e95-8901-4edd9857efee tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:47.649115 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0d85dc80-b196-4e95-8901-4edd9857efee tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:47.656939 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0d85dc80-b196-4e95-8901-4edd9857efee tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:47.657567 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0d85dc80-b196-4e95-8901-4edd9857efee tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:47.658382 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0d85dc80-b196-4e95-8901-4edd9857efee tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:47.658801 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0d85dc80-b196-4e95-8901-4edd9857efee tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:47.775221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:47.775988 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:47.785952 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:47.786443 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:47.787385 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:47.787875 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:47.899747 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-0d85dc80-b196-4e95-8901-4edd9857efee tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:47.909175 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0d85dc80-b196-4e95-8901-4edd9857efee tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.271582 Dec 16 14:48:47.909763 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 533/1093] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:47 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:48.049647 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:48.064410 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:48.072793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:48.074007 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ea4274b2-a723-4907-9e0f-fe09564f0fb6 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.308940 Dec 16 14:48:48.074564 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 561/1094] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:47 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:48.384922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cabc87bc-fa32-48fe-a5a8-04d6e8100807 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:48.385983 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cabc87bc-fa32-48fe-a5a8-04d6e8100807 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:48.399391 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cabc87bc-fa32-48fe-a5a8-04d6e8100807 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:48.399391 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cabc87bc-fa32-48fe-a5a8-04d6e8100807 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:48.400269 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cabc87bc-fa32-48fe-a5a8-04d6e8100807 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:48.400409 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cabc87bc-fa32-48fe-a5a8-04d6e8100807 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:48.745825 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cabc87bc-fa32-48fe-a5a8-04d6e8100807 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:48.755739 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cabc87bc-fa32-48fe-a5a8-04d6e8100807 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.382517 Dec 16 14:48:48.756632 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 534/1095] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:48 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:48.941964 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5dcc6d8a-9852-4716-b6a7-9dc31fc54f3c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:48.942666 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5dcc6d8a-9852-4716-b6a7-9dc31fc54f3c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:48.951447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5dcc6d8a-9852-4716-b6a7-9dc31fc54f3c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:48.952037 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5dcc6d8a-9852-4716-b6a7-9dc31fc54f3c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:48.952894 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5dcc6d8a-9852-4716-b6a7-9dc31fc54f3c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:48.953433 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5dcc6d8a-9852-4716-b6a7-9dc31fc54f3c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:49.099972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:49.100658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:49.108659 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:49.109155 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:49.109975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:49.110605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:49.275495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5dcc6d8a-9852-4716-b6a7-9dc31fc54f3c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:49.284903 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5dcc6d8a-9852-4716-b6a7-9dc31fc54f3c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.361408 Dec 16 14:48:49.285783 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 562/1096] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:48 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:49.348496 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:49.365214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:49.372284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:49.373369 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-bd4b9de4-a22c-4778-8874-a74f847443c2 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.284351 Dec 16 14:48:49.374054 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 535/1097] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:49 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:48:49.597518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-17d8a6d8-89c0-4265-bc53-88fc33f27b39 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-154229795"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:49.598089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-17d8a6d8-89c0-4265-bc53-88fc33f27b39 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:49.606280 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-17d8a6d8-89c0-4265-bc53-88fc33f27b39 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:49.606742 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-17d8a6d8-89c0-4265-bc53-88fc33f27b39 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:49.607542 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-17d8a6d8-89c0-4265-bc53-88fc33f27b39 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:49.607963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-17d8a6d8-89c0-4265-bc53-88fc33f27b39 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:49.781760 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c922e717-6d0d-4e6d-8e5a-7b7f1bba13e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:49.782742 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c922e717-6d0d-4e6d-8e5a-7b7f1bba13e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:49.790877 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c922e717-6d0d-4e6d-8e5a-7b7f1bba13e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:49.791318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c922e717-6d0d-4e6d-8e5a-7b7f1bba13e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:49.792165 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c922e717-6d0d-4e6d-8e5a-7b7f1bba13e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:49.792600 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c922e717-6d0d-4e6d-8e5a-7b7f1bba13e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:49.863138 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.network.security_group_api [None req-17d8a6d8-89c0-4265-bc53-88fc33f27b39 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Removing security group 2c7efa2f-6da1-49a8-9d90-17497c9c4b6f from port a286353e-4b59-4c95-8963-0d90f65f6f8b Dec 16 14:48:50.163290 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c922e717-6d0d-4e6d-8e5a-7b7f1bba13e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:50.174494 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c922e717-6d0d-4e6d-8e5a-7b7f1bba13e5 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.403384 Dec 16 14:48:50.175250 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 536/1098] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:49 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:50.308894 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8107e43e-5a65-422b-8633-5d58eb000524 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:50.309558 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8107e43e-5a65-422b-8633-5d58eb000524 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:50.317565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8107e43e-5a65-422b-8633-5d58eb000524 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:50.318116 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8107e43e-5a65-422b-8633-5d58eb000524 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:50.318807 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8107e43e-5a65-422b-8633-5d58eb000524 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:50.319224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8107e43e-5a65-422b-8633-5d58eb000524 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:50.514832 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-17d8a6d8-89c0-4265-bc53-88fc33f27b39 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "POST /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/action" status: 202 len: 0 microversion: 2.1 time: 0.927044 Dec 16 14:48:50.519481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 563/1099] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:49 2021] POST /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/action => generated 0 bytes in 935 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:48:50.531118 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:50.532909 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:50.543767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:50.544923 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:50.546027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:50.550393 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:50.643490 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8107e43e-5a65-422b-8633-5d58eb000524 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:50.664340 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8107e43e-5a65-422b-8633-5d58eb000524 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.366615 Dec 16 14:48:50.675337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 537/1100] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:50 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:50.685972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-84cd0c99-8d6c-4278-8fed-3a10d6260039 req-4d808991-a4cc-4c95-940d-fb5a4f59f47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f3f655-81f2-49a1-8ae3-1961c329487b", "tag": "a286353e-4b59-4c95-8963-0d90f65f6f8b"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:50.693553 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:48:50.693553 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:48:50.704638 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-84cd0c99-8d6c-4278-8fed-3a10d6260039 req-4d808991-a4cc-4c95-940d-fb5a4f59f47a service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:50.705557 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-84cd0c99-8d6c-4278-8fed-3a10d6260039 req-4d808991-a4cc-4c95-940d-fb5a4f59f47a service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:50.750646 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-84cd0c99-8d6c-4278-8fed-3a10d6260039 req-4d808991-a4cc-4c95-940d-fb5a4f59f47a service nova] Creating event network-changed:a286353e-4b59-4c95-8963-0d90f65f6f8b for instance 65f3f655-81f2-49a1-8ae3-1961c329487b on hv-cinder-82189 Dec 16 14:48:50.756511 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-84cd0c99-8d6c-4278-8fed-3a10d6260039 req-4d808991-a4cc-4c95-940d-fb5a4f59f47a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079634 Dec 16 14:48:50.757407 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 538/1101] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:48:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:50.909659 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:50.943618 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:50.961313 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:50.964607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0c9b8cb9-2ddb-4211-a00b-7b20396715f7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.443407 Dec 16 14:48:50.967585 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 564/1102] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:50 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:51.199238 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-888cea54-9d16-424a-8f16-032f9cef8abf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:51.199985 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-888cea54-9d16-424a-8f16-032f9cef8abf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:51.208946 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-888cea54-9d16-424a-8f16-032f9cef8abf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:51.209450 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-888cea54-9d16-424a-8f16-032f9cef8abf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:51.210328 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-888cea54-9d16-424a-8f16-032f9cef8abf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:51.210750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-888cea54-9d16-424a-8f16-032f9cef8abf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:51.688117 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3bbe9835-fb3d-4ec3-9878-52cefde81155 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:51.688976 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3bbe9835-fb3d-4ec3-9878-52cefde81155 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:51.698632 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3bbe9835-fb3d-4ec3-9878-52cefde81155 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:51.699420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3bbe9835-fb3d-4ec3-9878-52cefde81155 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:51.700389 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3bbe9835-fb3d-4ec3-9878-52cefde81155 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:51.700806 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3bbe9835-fb3d-4ec3-9878-52cefde81155 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:51.753414 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-888cea54-9d16-424a-8f16-032f9cef8abf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:51.764044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-888cea54-9d16-424a-8f16-032f9cef8abf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.575091 Dec 16 14:48:51.772845 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 539/1103] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:51 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:51.941654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3bbe9835-fb3d-4ec3-9878-52cefde81155 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:51.950852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3bbe9835-fb3d-4ec3-9878-52cefde81155 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.272408 Dec 16 14:48:51.951434 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 565/1104] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:51 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:52.002770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:52.003383 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:52.011916 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:52.012171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:52.012956 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:52.013377 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:52.441926 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:52.458154 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:52.466267 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:52.467465 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-570cd431-e749-4055-8218-50aee8c362db tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.477834 Dec 16 14:48:52.468036 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 540/1105] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:51 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:52.788376 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3c2330a2-eed9-4b17-b879-a326c08bbadc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:52.789652 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3c2330a2-eed9-4b17-b879-a326c08bbadc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:52.797242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3c2330a2-eed9-4b17-b879-a326c08bbadc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:52.797756 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3c2330a2-eed9-4b17-b879-a326c08bbadc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:52.798798 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3c2330a2-eed9-4b17-b879-a326c08bbadc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:52.799253 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3c2330a2-eed9-4b17-b879-a326c08bbadc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:52.975284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1a5f0e74-4dc1-44a4-8c62-0ee9fe1ce035 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:52.975897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1a5f0e74-4dc1-44a4-8c62-0ee9fe1ce035 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:52.984366 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1a5f0e74-4dc1-44a4-8c62-0ee9fe1ce035 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:52.985246 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1a5f0e74-4dc1-44a4-8c62-0ee9fe1ce035 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:52.986123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1a5f0e74-4dc1-44a4-8c62-0ee9fe1ce035 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:52.986739 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1a5f0e74-4dc1-44a4-8c62-0ee9fe1ce035 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:53.135952 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3c2330a2-eed9-4b17-b879-a326c08bbadc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:53.145726 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3c2330a2-eed9-4b17-b879-a326c08bbadc tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.367281 Dec 16 14:48:53.146759 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 566/1106] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:52 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:53.159436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9f5a7999-e89d-4b36-81ac-c5e307931f27 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:53.160267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9f5a7999-e89d-4b36-81ac-c5e307931f27 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:53.168574 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f5a7999-e89d-4b36-81ac-c5e307931f27 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:53.169428 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f5a7999-e89d-4b36-81ac-c5e307931f27 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:53.170492 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f5a7999-e89d-4b36-81ac-c5e307931f27 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:53.171241 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f5a7999-e89d-4b36-81ac-c5e307931f27 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:53.244333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1a5f0e74-4dc1-44a4-8c62-0ee9fe1ce035 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:53.253693 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1a5f0e74-4dc1-44a4-8c62-0ee9fe1ce035 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.288184 Dec 16 14:48:53.263108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 541/1107] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:52 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:53.265645 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-816fbbb5-e5de-491b-b630-d308fc4f60c7 req-2a1f82cd-993d-446e-82ef-be3ab8f7ef7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f3f655-81f2-49a1-8ae3-1961c329487b", "tag": "a286353e-4b59-4c95-8963-0d90f65f6f8b"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:53.278721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:48:53.278721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:48:53.288387 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-816fbbb5-e5de-491b-b630-d308fc4f60c7 req-2a1f82cd-993d-446e-82ef-be3ab8f7ef7c service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:53.288821 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-816fbbb5-e5de-491b-b630-d308fc4f60c7 req-2a1f82cd-993d-446e-82ef-be3ab8f7ef7c service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:53.306975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-816fbbb5-e5de-491b-b630-d308fc4f60c7 req-2a1f82cd-993d-446e-82ef-be3ab8f7ef7c service nova] Creating event network-changed:a286353e-4b59-4c95-8963-0d90f65f6f8b for instance 65f3f655-81f2-49a1-8ae3-1961c329487b on hv-cinder-82189 Dec 16 14:48:53.311844 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-816fbbb5-e5de-491b-b630-d308fc4f60c7 req-2a1f82cd-993d-446e-82ef-be3ab8f7ef7c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055488 Dec 16 14:48:53.312667 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 542/1108] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:48:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:53.473851 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9f5a7999-e89d-4b36-81ac-c5e307931f27 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "DELETE /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments/b0b57206-6e00-4b3e-bd8c-92bec07610a2" status: 202 len: 0 microversion: 2.1 time: 0.324929 Dec 16 14:48:53.474870 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 567/1109] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:48:53 2021] DELETE /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments/b0b57206-6e00-4b3e-bd8c-92bec07610a2 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:48:53.494601 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5b1a3f95-870a-4c61-b635-523fc633d3ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:53.495849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5b1a3f95-870a-4c61-b635-523fc633d3ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:53.504449 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b1a3f95-870a-4c61-b635-523fc633d3ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:53.504908 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b1a3f95-870a-4c61-b635-523fc633d3ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:53.505726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b1a3f95-870a-4c61-b635-523fc633d3ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:53.506398 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5b1a3f95-870a-4c61-b635-523fc633d3ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:53.508342 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:53.509643 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:53.523416 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:53.523935 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:53.524972 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:53.525404 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:53.584603 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5b1a3f95-870a-4c61-b635-523fc633d3ad tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104411 Dec 16 14:48:53.585587 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 543/1110] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:48:53 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:53.774826 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:53.790594 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:53.797204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:53.799214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-83fb2192-9eeb-48dd-bc0e-b5c057ec1153 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.309912 Dec 16 14:48:53.808524 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 568/1111] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:53 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:54.179066 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8cba28d3-d466-4219-9218-e3108eba0280 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:54.181764 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8cba28d3-d466-4219-9218-e3108eba0280 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:54.208329 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8cba28d3-d466-4219-9218-e3108eba0280 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:54.209408 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8cba28d3-d466-4219-9218-e3108eba0280 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:54.210504 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8cba28d3-d466-4219-9218-e3108eba0280 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:54.214533 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8cba28d3-d466-4219-9218-e3108eba0280 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:54.291199 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-175f4664-1613-4b44-8f50-8262e639f06c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:54.292305 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-175f4664-1613-4b44-8f50-8262e639f06c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:54.320134 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-175f4664-1613-4b44-8f50-8262e639f06c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:54.321503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-175f4664-1613-4b44-8f50-8262e639f06c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:54.323244 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-175f4664-1613-4b44-8f50-8262e639f06c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:54.324206 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-175f4664-1613-4b44-8f50-8262e639f06c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:54.928724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8cba28d3-d466-4219-9218-e3108eba0280 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:54.945620 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8cba28d3-d466-4219-9218-e3108eba0280 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1447 microversion: 2.1 time: 0.783814 Dec 16 14:48:54.948849 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 544/1112] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:54 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1447 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:48:54.983947 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-175f4664-1613-4b44-8f50-8262e639f06c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:54.986627 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-888b2240-9696-4455-b2cc-25aa6729585b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:54.987605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-888b2240-9696-4455-b2cc-25aa6729585b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:54.996012 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-888b2240-9696-4455-b2cc-25aa6729585b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:54.996796 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-888b2240-9696-4455-b2cc-25aa6729585b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:54.997753 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-888b2240-9696-4455-b2cc-25aa6729585b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:54.998389 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-888b2240-9696-4455-b2cc-25aa6729585b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:55.000302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-175f4664-1613-4b44-8f50-8262e639f06c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.731962 Dec 16 14:48:55.010548 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 569/1113] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:54 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:55.043500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:55.045763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:55.065857 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:55.067089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:55.068844 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:55.069907 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:55.137686 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-888b2240-9696-4455-b2cc-25aa6729585b tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183600 Dec 16 14:48:55.139275 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 545/1114] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:48:54 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:55.331659 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:55.348103 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:55.354837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:55.356019 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-427882e5-2fcd-473d-b92b-ce7c96e29bad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.344023 Dec 16 14:48:55.356568 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 570/1115] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:55 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:55.975890 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-79740372-1641-41b5-b1c5-07fe5077bbf0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:55.976595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-79740372-1641-41b5-b1c5-07fe5077bbf0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:55.984765 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-79740372-1641-41b5-b1c5-07fe5077bbf0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:55.985197 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-79740372-1641-41b5-b1c5-07fe5077bbf0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:55.986231 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-79740372-1641-41b5-b1c5-07fe5077bbf0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:55.986665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-79740372-1641-41b5-b1c5-07fe5077bbf0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.053018 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5dd5e76a-90fc-486e-bc58-6f827e216175 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:56.053691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5dd5e76a-90fc-486e-bc58-6f827e216175 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:56.074396 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5dd5e76a-90fc-486e-bc58-6f827e216175 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:56.075296 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5dd5e76a-90fc-486e-bc58-6f827e216175 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.076273 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5dd5e76a-90fc-486e-bc58-6f827e216175 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:56.076870 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5dd5e76a-90fc-486e-bc58-6f827e216175 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.166421 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-79740372-1641-41b5-b1c5-07fe5077bbf0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:56.179896 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-79740372-1641-41b5-b1c5-07fe5077bbf0 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1380 microversion: 2.1 time: 0.218349 Dec 16 14:48:56.181141 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 546/1116] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:55 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1380 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:56.195907 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-d16e86c5-a22b-447b-b8c8-596d4fcb19a5 req-3ef82f94-4f69-4421-a72a-d8fbdb6763f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6e43c8-eea5-48d0-b7bf-ff18381a0f20", "name": "network-vif-deleted", "tag": "a1de2547-6459-4d87-9d1f-a9adfc216809"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:56.202605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:48:56.202605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:48:56.212243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-d16e86c5-a22b-447b-b8c8-596d4fcb19a5 req-3ef82f94-4f69-4421-a72a-d8fbdb6763f1 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:56.213062 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-d16e86c5-a22b-447b-b8c8-596d4fcb19a5 req-3ef82f94-4f69-4421-a72a-d8fbdb6763f1 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.238021 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-d16e86c5-a22b-447b-b8c8-596d4fcb19a5 req-3ef82f94-4f69-4421-a72a-d8fbdb6763f1 service nova] Creating event network-vif-deleted:a1de2547-6459-4d87-9d1f-a9adfc216809 for instance fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 on hv-cinder-82189 Dec 16 14:48:56.247140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-d16e86c5-a22b-447b-b8c8-596d4fcb19a5 req-3ef82f94-4f69-4421-a72a-d8fbdb6763f1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063549 Dec 16 14:48:56.248222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 547/1117] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:56.264350 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-be3fe999-eb55-4128-b72e-35c4e89a695c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:56.265969 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-be3fe999-eb55-4128-b72e-35c4e89a695c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:56.278829 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be3fe999-eb55-4128-b72e-35c4e89a695c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:56.279748 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be3fe999-eb55-4128-b72e-35c4e89a695c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.280848 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be3fe999-eb55-4128-b72e-35c4e89a695c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:56.281689 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be3fe999-eb55-4128-b72e-35c4e89a695c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.416552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-be3fe999-eb55-4128-b72e-35c4e89a695c tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.164209 Dec 16 14:48:56.421932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 548/1118] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:48:56 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments => generated 25 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:56.429039 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:56.429656 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:56.438080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:56.438530 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.439348 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:56.439747 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.690204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5dd5e76a-90fc-486e-bc58-6f827e216175 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:56.700259 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5dd5e76a-90fc-486e-bc58-6f827e216175 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1318 microversion: 2.1 time: 0.672311 Dec 16 14:48:56.701103 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 571/1119] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:56 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:56.706013 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:56.713622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2c00fa78-cc13-46b3-a029-2f8261bcab6d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:56.714163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2c00fa78-cc13-46b3-a029-2f8261bcab6d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:56.722557 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2c00fa78-cc13-46b3-a029-2f8261bcab6d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:56.723661 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2c00fa78-cc13-46b3-a029-2f8261bcab6d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.724674 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2c00fa78-cc13-46b3-a029-2f8261bcab6d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:56.725287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2c00fa78-cc13-46b3-a029-2f8261bcab6d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:56.726524 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:56.735264 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:56.736676 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-85f2dc3d-f575-4ad3-8fca-e705ddc73dc8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.317969 Dec 16 14:48:56.737360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 549/1120] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:56 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:56.924906 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-2c00fa78-cc13-46b3-a029-2f8261bcab6d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] HTTP exception thrown: Instance 65f3f655-81f2-49a1-8ae3-1961c329487b is not attached to volume b0b57206-6e00-4b3e-bd8c-92bec07610a2 Dec 16 14:48:56.925501 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2c00fa78-cc13-46b3-a029-2f8261bcab6d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Returning 404 to user: Instance 65f3f655-81f2-49a1-8ae3-1961c329487b is not attached to volume b0b57206-6e00-4b3e-bd8c-92bec07610a2 {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:48:56.926436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2c00fa78-cc13-46b3-a029-2f8261bcab6d tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "DELETE /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments/b0b57206-6e00-4b3e-bd8c-92bec07610a2" status: 404 len: 154 microversion: 2.1 time: 0.224111 Dec 16 14:48:56.926986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 572/1121] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:48:56 2021] DELETE /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b/os-volume_attachments/b0b57206-6e00-4b3e-bd8c-92bec07610a2 => generated 154 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:48:57.204892 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:57.205521 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:57.214163 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:57.214735 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:57.215758 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:57.216316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:57.319915 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:57.320454 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:57.320948 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.objects.instance [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lazy-loading 'fault' on Instance uuid fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 {{(pid=96669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:48:57.395299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60acaee6050143099c2ded8515eab3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a687d83941a46d8893bb58f302b2951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:57.405738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fa806654-d825-40a6-bc9c-09c65af67edf tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 200 len: 1222 microversion: 2.1 time: 0.210121 Dec 16 14:48:57.407400 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 550/1122] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:57 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:57.724172 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-16145ef9-d4d5-454d-9ae1-7eb1e1111d4c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:57.725455 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-16145ef9-d4d5-454d-9ae1-7eb1e1111d4c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:57.733832 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16145ef9-d4d5-454d-9ae1-7eb1e1111d4c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:57.734453 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16145ef9-d4d5-454d-9ae1-7eb1e1111d4c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:57.735239 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16145ef9-d4d5-454d-9ae1-7eb1e1111d4c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:57.735656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-16145ef9-d4d5-454d-9ae1-7eb1e1111d4c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:57.762812 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:57.763575 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:57.773385 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:57.773961 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:57.774858 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:57.775357 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:57.984879 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-16145ef9-d4d5-454d-9ae1-7eb1e1111d4c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:57.994741 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-16145ef9-d4d5-454d-9ae1-7eb1e1111d4c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1508 microversion: 2.1 time: 0.280387 Dec 16 14:48:57.995323 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 573/1123] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:57 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:58.031662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:58.046319 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:58.053359 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:58.054602 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-343a913c-0a30-4e0c-9ce1-d29336690ccb tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.302534 Dec 16 14:48:58.055259 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 551/1124] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:57 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:48:58.201084 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d95060c0-61d8-4795-a645-a2b67713e582 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:58.201706 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d95060c0-61d8-4795-a645-a2b67713e582 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:58.211462 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d95060c0-61d8-4795-a645-a2b67713e582 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:58.212059 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d95060c0-61d8-4795-a645-a2b67713e582 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:58.212970 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d95060c0-61d8-4795-a645-a2b67713e582 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:58.213467 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d95060c0-61d8-4795-a645-a2b67713e582 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:58.286482 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d95060c0-61d8-4795-a645-a2b67713e582 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Going to try to terminate instance {{(pid=96670) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:48:58.431367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ee7a1fea-cc2d-4dce-9c7b-13f09b56d006 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:58.431981 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ee7a1fea-cc2d-4dce-9c7b-13f09b56d006 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] [instance: fd6e43c8-eea5-48d0-b7bf-ff18381a0f20] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:58.452102 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee7a1fea-cc2d-4dce-9c7b-13f09b56d006 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:58.452608 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee7a1fea-cc2d-4dce-9c7b-13f09b56d006 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:58.453829 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee7a1fea-cc2d-4dce-9c7b-13f09b56d006 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:58.454010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ee7a1fea-cc2d-4dce-9c7b-13f09b56d006 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:58.574397 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-ee7a1fea-cc2d-4dce-9c7b-13f09b56d006 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] HTTP exception thrown: Instance fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 could not be found. Dec 16 14:48:58.575284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ee7a1fea-cc2d-4dce-9c7b-13f09b56d006 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Returning 404 to user: Instance fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:48:58.576169 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ee7a1fea-cc2d-4dce-9c7b-13f09b56d006 tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20" status: 404 len: 111 microversion: 2.1 time: 0.154864 Dec 16 14:48:58.580949 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 552/1125] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:58 2021] GET /compute/v2.1/servers/fd6e43c8-eea5-48d0-b7bf-ff18381a0f20 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:48:58.660641 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d95060c0-61d8-4795-a645-a2b67713e582 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "DELETE /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 204 len: 0 microversion: 2.1 time: 0.469172 Dec 16 14:48:58.662685 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 574/1126] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:48:58 2021] DELETE /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:48:58.679595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-19177359-e8c8-4315-a9a9-aa156d1a6300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:58.680537 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-19177359-e8c8-4315-a9a9-aa156d1a6300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:58.690744 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-19177359-e8c8-4315-a9a9-aa156d1a6300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:58.691186 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-19177359-e8c8-4315-a9a9-aa156d1a6300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:58.692239 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-19177359-e8c8-4315-a9a9-aa156d1a6300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:58.692659 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-19177359-e8c8-4315-a9a9-aa156d1a6300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:58.869578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-33f2cb02-7870-49c9-b729-7fd8de17f7da tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] Calling method '.version_select at 0x7f26fe373f70>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:58.895744 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-33f2cb02-7870-49c9-b729-7fd8de17f7da tempest-TestShelveInstance-1305331668 tempest-TestShelveInstance-1305331668-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-110580736" status: 202 len: 0 microversion: 2.1 time: 0.048688 Dec 16 14:48:58.896314 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 575/1127] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Dec 16 14:48:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-110580736 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:48:58.973381 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-19177359-e8c8-4315-a9a9-aa156d1a6300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:58.984716 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-19177359-e8c8-4315-a9a9-aa156d1a6300 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1552 microversion: 2.1 time: 0.317058 Dec 16 14:48:58.985548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 553/1128] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:58 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1552 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:59.079868 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:59.080909 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:59.092565 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:59.094502 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:59.096453 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:59.097662 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:59.493759 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:59.509793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:59.517184 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:48:59.518399 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e96bab78-191a-4b68-8bde-8be890b9c45e tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.448324 Dec 16 14:48:59.519207 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 576/1129] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:48:59 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:59.744203 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1fd66f16-0e0e-462a-8f0e-4619a5996f76 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccfaf36b-e182-4799-bb3e-dc8dfa9969ed"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:59.745347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1fd66f16-0e0e-462a-8f0e-4619a5996f76 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:48:59.754022 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1fd66f16-0e0e-462a-8f0e-4619a5996f76 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:59.754475 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1fd66f16-0e0e-462a-8f0e-4619a5996f76 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:59.755301 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1fd66f16-0e0e-462a-8f0e-4619a5996f76 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:59.755801 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1fd66f16-0e0e-462a-8f0e-4619a5996f76 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:00.010487 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-213ce53c-5925-4d7b-9c53-3feb77f1dbf0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:00.011125 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-213ce53c-5925-4d7b-9c53-3feb77f1dbf0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:00.022449 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-213ce53c-5925-4d7b-9c53-3feb77f1dbf0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:00.022924 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-213ce53c-5925-4d7b-9c53-3feb77f1dbf0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:00.024107 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-213ce53c-5925-4d7b-9c53-3feb77f1dbf0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:00.024712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-213ce53c-5925-4d7b-9c53-3feb77f1dbf0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:00.298338 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1fd66f16-0e0e-462a-8f0e-4619a5996f76 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "POST /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563816 Dec 16 14:49:00.299526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 554/1130] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:48:59 2021] POST /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:00.481370 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-213ce53c-5925-4d7b-9c53-3feb77f1dbf0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:00.492995 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-213ce53c-5925-4d7b-9c53-3feb77f1dbf0 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1552 microversion: 2.1 time: 0.493823 Dec 16 14:49:00.493813 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 577/1131] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:59 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1552 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:00.552888 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:00.554532 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:00.564052 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:00.564505 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:00.565298 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:00.565914 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:00.811244 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:00.827596 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:00.834217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:00.835366 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-39cc5656-f1ff-4636-a47e-5b89db5dfbd5 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.300861 Dec 16 14:49:00.835893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 555/1132] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:49:00 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:49:01.527687 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5e4a872e-7099-4fc3-bf89-26aed39d6a26 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:01.529777 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5e4a872e-7099-4fc3-bf89-26aed39d6a26 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:01.541138 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5e4a872e-7099-4fc3-bf89-26aed39d6a26 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:01.541578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5e4a872e-7099-4fc3-bf89-26aed39d6a26 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:01.543168 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5e4a872e-7099-4fc3-bf89-26aed39d6a26 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:01.543168 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5e4a872e-7099-4fc3-bf89-26aed39d6a26 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:01.863191 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:01.863978 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:01.876055 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:01.876784 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:01.878463 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:01.879295 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:02.188064 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:02.209192 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5e4a872e-7099-4fc3-bf89-26aed39d6a26 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:02.216432 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:02.218818 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5e4a872e-7099-4fc3-bf89-26aed39d6a26 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1552 microversion: 2.1 time: 0.710552 Dec 16 14:49:02.219568 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 578/1133] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:01 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1552 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:02.234046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:02.235435 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e83e1254-08b7-468c-b4e7-a8c98ae62ab7 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.384680 Dec 16 14:49:02.236214 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 556/1134] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:49:01 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:49:02.840327 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-c45dbe55-249b-4a85-adc4-24f4022c7bb1 req-f3132346-41d9-4802-88a6-dd9845a451fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f3f655-81f2-49a1-8ae3-1961c329487b", "name": "network-vif-deleted", "tag": "a286353e-4b59-4c95-8963-0d90f65f6f8b"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:02.847778 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:49:02.847778 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:49:02.858483 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-c45dbe55-249b-4a85-adc4-24f4022c7bb1 req-f3132346-41d9-4802-88a6-dd9845a451fe service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:02.858927 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-c45dbe55-249b-4a85-adc4-24f4022c7bb1 req-f3132346-41d9-4802-88a6-dd9845a451fe service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:02.883159 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-c45dbe55-249b-4a85-adc4-24f4022c7bb1 req-f3132346-41d9-4802-88a6-dd9845a451fe service nova] Creating event network-vif-deleted:a286353e-4b59-4c95-8963-0d90f65f6f8b for instance 65f3f655-81f2-49a1-8ae3-1961c329487b on hv-cinder-82189 Dec 16 14:49:02.889110 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-c45dbe55-249b-4a85-adc4-24f4022c7bb1 req-f3132346-41d9-4802-88a6-dd9845a451fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058985 Dec 16 14:49:02.890702 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 579/1135] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:49:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:03.229840 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-d57ef0ec-153a-4561-aa45-4a250ab3ec64 req-4cc17cf8-3561-4f95-8552-4137b290902a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd517a0-bd8a-4e52-93ac-304678993d24", "name": "network-vif-plugged", "status": "completed", "tag": "89eb0392-5a52-4cad-8793-177f104836c0"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:03.242967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:49:03.242967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:49:03.251765 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:03.252479 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:03.254999 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-d57ef0ec-153a-4561-aa45-4a250ab3ec64 req-4cc17cf8-3561-4f95-8552-4137b290902a service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:03.255754 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-d57ef0ec-153a-4561-aa45-4a250ab3ec64 req-4cc17cf8-3561-4f95-8552-4137b290902a service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:03.263035 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:03.263765 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:03.265499 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:03.266307 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:03.283534 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-d57ef0ec-153a-4561-aa45-4a250ab3ec64 req-4cc17cf8-3561-4f95-8552-4137b290902a service nova] Creating event network-vif-plugged:89eb0392-5a52-4cad-8793-177f104836c0 for instance 1bd517a0-bd8a-4e52-93ac-304678993d24 on hv-cinder-82189 Dec 16 14:49:03.292317 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-d57ef0ec-153a-4561-aa45-4a250ab3ec64 req-4cc17cf8-3561-4f95-8552-4137b290902a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079831 Dec 16 14:49:03.293787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 557/1136] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:49:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:49:03.327181 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:03.329263 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:03.355336 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:03.357019 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:03.358783 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:03.359850 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:03.373460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:03.374120 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:03.374739 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lazy-loading 'fault' on Instance uuid 65f3f655-81f2-49a1-8ae3-1961c329487b {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:49:03.544705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a0ea6ec044d0a8f5f2ba192414a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7210fc0bdd80446484aaf7f436c2317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:03.557069 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5f0b786f-7487-4990-bc84-331cca077240 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 200 len: 1346 microversion: 2.1 time: 0.319863 Dec 16 14:49:03.558772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 580/1137] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:03 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 1346 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:49:03.637240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:03.652169 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:03.659679 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:03.660675 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ac28217a-4ba3-40f5-bc3d-8a734ca7c2e1 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.365057 Dec 16 14:49:03.661790 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 558/1138] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:49:03 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:49:04.582109 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ef1e1750-adaf-4a7f-bc23-e3bc673e6d0a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:04.582844 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ef1e1750-adaf-4a7f-bc23-e3bc673e6d0a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] [instance: 65f3f655-81f2-49a1-8ae3-1961c329487b] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:04.593088 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ef1e1750-adaf-4a7f-bc23-e3bc673e6d0a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:04.594194 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ef1e1750-adaf-4a7f-bc23-e3bc673e6d0a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:04.595930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ef1e1750-adaf-4a7f-bc23-e3bc673e6d0a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:04.597068 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ef1e1750-adaf-4a7f-bc23-e3bc673e6d0a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:04.668731 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-ef1e1750-adaf-4a7f-bc23-e3bc673e6d0a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] HTTP exception thrown: Instance 65f3f655-81f2-49a1-8ae3-1961c329487b could not be found. Dec 16 14:49:04.669676 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ef1e1750-adaf-4a7f-bc23-e3bc673e6d0a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Returning 404 to user: Instance 65f3f655-81f2-49a1-8ae3-1961c329487b could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:49:04.670431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ef1e1750-adaf-4a7f-bc23-e3bc673e6d0a tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b" status: 404 len: 111 microversion: 2.1 time: 0.099511 Dec 16 14:49:04.671053 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 581/1139] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:04 2021] GET /compute/v2.1/servers/65f3f655-81f2-49a1-8ae3-1961c329487b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:49:04.684973 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:04.686433 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:04.688359 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-93db20b8-365e-41a0-a54d-4460dfc65d14 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] Calling method '.version_select at 0x7f26fe6afdc0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:04.695878 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:04.696704 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:04.697729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:04.698514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:04.718604 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-93db20b8-365e-41a0-a54d-4460dfc65d14 tempest-TestMinimumBasicScenario-489262293 tempest-TestMinimumBasicScenario-489262293-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-17377784" status: 202 len: 0 microversion: 2.1 time: 0.040050 Dec 16 14:49:04.719947 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 582/1140] 10.222.0.67 () {58 vars in 1265 bytes} [Thu Dec 16 14:49:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-17377784 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:49:04.960603 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:04.980569 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:04.987321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:04.988668 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ce7a232d-5426-4d81-bd03-b0b0435514a8 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.313920 Dec 16 14:49:04.989397 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 559/1141] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:49:04 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:49:06.032945 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:06.035326 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:06.058613 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:06.067047 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:06.077242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:06.077712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:06.528650 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:06.545289 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:06.552322 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:06.553979 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e8bd7e50-c3ce-4b0a-956e-667258f31f78 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1731 microversion: 2.20 time: 0.549080 Dec 16 14:49:06.554815 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 583/1142] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:49:06 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1731 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:49:07.585909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:07.586927 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:07.594797 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:07.595233 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:07.596188 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:07.596633 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:08.109336 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:08.157367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:08.167196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:08.168925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cf0f9b3e-e86f-499a-990e-0be5d4aea963 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1718 microversion: 2.20 time: 0.599394 Dec 16 14:49:08.185453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 560/1143] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:49:07 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1718 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:49:08.466378 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1056071034", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "networks": [{"uuid": "32e1bc01-b84b-4784-8fab-5e9379c8e7dd"}]}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:08.543901 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.network.neutron [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] validate_networks() for [('32e1bc01-b84b-4784-8fab-5e9379c8e7dd', None, None, None)] {{(pid=96670) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:49:09.480656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Flavor limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:49:09.482861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Image limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:49:09.484009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Flavor pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:49:09.484605 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Image pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:49:09.485178 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:49:09.502793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:09.503890 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:09.506495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:09.507382 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:09.533896 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Getting quotas for project eb6df6b44f0d42339c2fd1095ce3bdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:49:09.543301 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Getting quotas for user 9a05ec0df9334b0ca96bffdd9fdfe99d and project eb6df6b44f0d42339c2fd1095ce3bdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:49:09.563319 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Going to run 1 instances... {{(pid=96670) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:49:09.568980 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:49:09.631951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [dd7e8103-8863-4dfa-9bad-9229124ba989] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:49:10.651387 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [dd7e8103-8863-4dfa-9bad-9229124ba989] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 39150. Dec 16 14:49:10.668362 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f0d68f6b-a2b2-449a-9694-6e971d27ecb0 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.212196 Dec 16 14:49:10.678413 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 584/1144] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:49:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 2223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:49:10.689357 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a17f0e27-496a-4b08-9c96-572eaac98d1d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:10.689970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a17f0e27-496a-4b08-9c96-572eaac98d1d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:10.798028 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a17f0e27-496a-4b08-9c96-572eaac98d1d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:10.810727 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a17f0e27-496a-4b08-9c96-572eaac98d1d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1218 microversion: 2.1 time: 0.131124 Dec 16 14:49:10.812079 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 561/1145] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:10 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:49:11.834368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-894c12a1-ef35-4232-9c17-6ba132afba93 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:11.835907 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-894c12a1-ef35-4232-9c17-6ba132afba93 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:11.851530 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-894c12a1-ef35-4232-9c17-6ba132afba93 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:11.852152 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-894c12a1-ef35-4232-9c17-6ba132afba93 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:11.852942 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-894c12a1-ef35-4232-9c17-6ba132afba93 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:11.854040 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-894c12a1-ef35-4232-9c17-6ba132afba93 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:12.086541 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-894c12a1-ef35-4232-9c17-6ba132afba93 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:12.108121 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-894c12a1-ef35-4232-9c17-6ba132afba93 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1270 microversion: 2.1 time: 0.283140 Dec 16 14:49:12.108767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 585/1146] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:11 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1270 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:13.134486 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e44f00db-753d-4314-87de-16e2aa591637 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:13.135914 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e44f00db-753d-4314-87de-16e2aa591637 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:13.144665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e44f00db-753d-4314-87de-16e2aa591637 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:13.145476 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e44f00db-753d-4314-87de-16e2aa591637 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:13.146688 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e44f00db-753d-4314-87de-16e2aa591637 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:13.148473 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-e44f00db-753d-4314-87de-16e2aa591637 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:13.297105 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e44f00db-753d-4314-87de-16e2aa591637 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:13.313641 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e44f00db-753d-4314-87de-16e2aa591637 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1276 microversion: 2.1 time: 0.190338 Dec 16 14:49:13.324228 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 562/1147] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:13 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:14.338403 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d747d3d4-7dbc-4a78-bc18-06391b11a353 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:14.339116 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d747d3d4-7dbc-4a78-bc18-06391b11a353 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:14.347575 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d747d3d4-7dbc-4a78-bc18-06391b11a353 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:14.348265 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d747d3d4-7dbc-4a78-bc18-06391b11a353 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:14.349054 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d747d3d4-7dbc-4a78-bc18-06391b11a353 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:14.349817 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d747d3d4-7dbc-4a78-bc18-06391b11a353 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:15.459012 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d747d3d4-7dbc-4a78-bc18-06391b11a353 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:15.470021 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d747d3d4-7dbc-4a78-bc18-06391b11a353 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 1.141811 Dec 16 14:49:15.470860 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 586/1148] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:14 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:16.505606 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fc7c9524-ad7d-45e5-97a5-f2e03fbcd83d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:16.508028 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fc7c9524-ad7d-45e5-97a5-f2e03fbcd83d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:16.521386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fc7c9524-ad7d-45e5-97a5-f2e03fbcd83d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:16.521975 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fc7c9524-ad7d-45e5-97a5-f2e03fbcd83d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:16.523080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fc7c9524-ad7d-45e5-97a5-f2e03fbcd83d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:16.523724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fc7c9524-ad7d-45e5-97a5-f2e03fbcd83d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:16.963820 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fc7c9524-ad7d-45e5-97a5-f2e03fbcd83d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:16.977943 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fc7c9524-ad7d-45e5-97a5-f2e03fbcd83d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.486107 Dec 16 14:49:16.978992 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 563/1149] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:16 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:17.325037 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-1785ebe3-5b89-4b64-838a-b48991cf6471 req-af30027b-e3e2-4093-8c9d-b5a9be2d0dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "862411e7-45f6-48d0-b01d-37109c4d9afe", "tag": "d0b690af-263b-4ff0-8f48-ed3faf512395"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:17.333631 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:49:17.333631 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:49:17.343911 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-1785ebe3-5b89-4b64-838a-b48991cf6471 req-af30027b-e3e2-4093-8c9d-b5a9be2d0dee service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:17.344365 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-1785ebe3-5b89-4b64-838a-b48991cf6471 req-af30027b-e3e2-4093-8c9d-b5a9be2d0dee service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:17.367973 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-1785ebe3-5b89-4b64-838a-b48991cf6471 req-af30027b-e3e2-4093-8c9d-b5a9be2d0dee service nova] Creating event network-changed:d0b690af-263b-4ff0-8f48-ed3faf512395 for instance 862411e7-45f6-48d0-b01d-37109c4d9afe on hv-cinder-82189 Dec 16 14:49:17.373093 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-1785ebe3-5b89-4b64-838a-b48991cf6471 req-af30027b-e3e2-4093-8c9d-b5a9be2d0dee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064450 Dec 16 14:49:17.374042 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 587/1150] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:49:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:18.001777 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d7f6b0b3-e1e9-4a2a-9fd3-dfe6807c3cce tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:18.002378 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d7f6b0b3-e1e9-4a2a-9fd3-dfe6807c3cce tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:18.011737 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7f6b0b3-e1e9-4a2a-9fd3-dfe6807c3cce tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:18.012241 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7f6b0b3-e1e9-4a2a-9fd3-dfe6807c3cce tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:18.013012 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7f6b0b3-e1e9-4a2a-9fd3-dfe6807c3cce tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:18.013436 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7f6b0b3-e1e9-4a2a-9fd3-dfe6807c3cce tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:18.363495 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d7f6b0b3-e1e9-4a2a-9fd3-dfe6807c3cce tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:18.372036 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d7f6b0b3-e1e9-4a2a-9fd3-dfe6807c3cce tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.380012 Dec 16 14:49:18.372808 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 564/1151] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:17 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:19.404162 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8875a225-bc9b-4355-ba20-1bb325d68c8d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:19.406271 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8875a225-bc9b-4355-ba20-1bb325d68c8d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:19.429627 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8875a225-bc9b-4355-ba20-1bb325d68c8d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:19.430089 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8875a225-bc9b-4355-ba20-1bb325d68c8d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:19.431323 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8875a225-bc9b-4355-ba20-1bb325d68c8d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:19.432320 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8875a225-bc9b-4355-ba20-1bb325d68c8d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:20.281817 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8875a225-bc9b-4355-ba20-1bb325d68c8d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:20.291328 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8875a225-bc9b-4355-ba20-1bb325d68c8d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.903330 Dec 16 14:49:20.291910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 588/1152] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:19 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:21.313480 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2817b231-e012-4c1a-bb28-be553523ec21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:21.314119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2817b231-e012-4c1a-bb28-be553523ec21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:21.321970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2817b231-e012-4c1a-bb28-be553523ec21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:21.322750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2817b231-e012-4c1a-bb28-be553523ec21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:21.323508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2817b231-e012-4c1a-bb28-be553523ec21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:21.324118 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2817b231-e012-4c1a-bb28-be553523ec21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:21.552580 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2817b231-e012-4c1a-bb28-be553523ec21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:21.561403 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2817b231-e012-4c1a-bb28-be553523ec21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.257602 Dec 16 14:49:21.562268 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 565/1153] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:21 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:22.585278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-07847e96-9423-41a3-9f11-c78a2416a605 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:22.585888 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-07847e96-9423-41a3-9f11-c78a2416a605 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:22.598185 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-07847e96-9423-41a3-9f11-c78a2416a605 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:22.598620 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-07847e96-9423-41a3-9f11-c78a2416a605 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:22.599373 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-07847e96-9423-41a3-9f11-c78a2416a605 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:22.600023 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-07847e96-9423-41a3-9f11-c78a2416a605 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:22.892379 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-07847e96-9423-41a3-9f11-c78a2416a605 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:22.901919 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-07847e96-9423-41a3-9f11-c78a2416a605 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.327103 Dec 16 14:49:22.902563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 589/1154] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:22 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:23.927236 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d3dc71a9-e643-4cf5-b4bd-49b74effa539 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:23.927605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d3dc71a9-e643-4cf5-b4bd-49b74effa539 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:23.937099 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d3dc71a9-e643-4cf5-b4bd-49b74effa539 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:23.937863 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d3dc71a9-e643-4cf5-b4bd-49b74effa539 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:23.939171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d3dc71a9-e643-4cf5-b4bd-49b74effa539 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:23.939692 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d3dc71a9-e643-4cf5-b4bd-49b74effa539 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:24.186303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d3dc71a9-e643-4cf5-b4bd-49b74effa539 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:24.197331 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d3dc71a9-e643-4cf5-b4bd-49b74effa539 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.281214 Dec 16 14:49:24.207967 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 566/1155] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:23 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:25.221805 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e139e5b8-fc9a-4f09-932e-16a964b71464 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:25.222452 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e139e5b8-fc9a-4f09-932e-16a964b71464 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:25.230999 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e139e5b8-fc9a-4f09-932e-16a964b71464 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:25.231436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e139e5b8-fc9a-4f09-932e-16a964b71464 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:25.232231 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e139e5b8-fc9a-4f09-932e-16a964b71464 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:25.232657 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e139e5b8-fc9a-4f09-932e-16a964b71464 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:25.475644 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e139e5b8-fc9a-4f09-932e-16a964b71464 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:25.488740 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e139e5b8-fc9a-4f09-932e-16a964b71464 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.277371 Dec 16 14:49:25.489311 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 590/1156] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:25 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:26.512908 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8be03ba3-4e99-4413-b90a-9817fbd93a4a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:26.513510 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8be03ba3-4e99-4413-b90a-9817fbd93a4a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:26.521896 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8be03ba3-4e99-4413-b90a-9817fbd93a4a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:26.522362 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8be03ba3-4e99-4413-b90a-9817fbd93a4a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:26.523128 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8be03ba3-4e99-4413-b90a-9817fbd93a4a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:26.523549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8be03ba3-4e99-4413-b90a-9817fbd93a4a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:26.736674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8be03ba3-4e99-4413-b90a-9817fbd93a4a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:26.746544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8be03ba3-4e99-4413-b90a-9817fbd93a4a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.242846 Dec 16 14:49:26.747158 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 567/1157] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:26 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:27.289124 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-de7a808b-eebb-4786-a757-9eedd00113c8 req-67b82d22-82ea-487f-8db8-9174b3845d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862411e7-45f6-48d0-b01d-37109c4d9afe", "name": "network-vif-plugged", "status": "completed", "tag": "d0b690af-263b-4ff0-8f48-ed3faf512395"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:27.295563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:49:27.295563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:49:27.304144 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-de7a808b-eebb-4786-a757-9eedd00113c8 req-67b82d22-82ea-487f-8db8-9174b3845d97 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:27.304583 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-de7a808b-eebb-4786-a757-9eedd00113c8 req-67b82d22-82ea-487f-8db8-9174b3845d97 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:27.323931 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-de7a808b-eebb-4786-a757-9eedd00113c8 req-67b82d22-82ea-487f-8db8-9174b3845d97 service nova] Creating event network-vif-plugged:d0b690af-263b-4ff0-8f48-ed3faf512395 for instance 862411e7-45f6-48d0-b01d-37109c4d9afe on hv-cinder-82189 Dec 16 14:49:27.329863 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-de7a808b-eebb-4786-a757-9eedd00113c8 req-67b82d22-82ea-487f-8db8-9174b3845d97 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050454 Dec 16 14:49:27.330934 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 591/1158] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:49:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:27.770303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-80382cab-1ca1-428f-8f10-b8bd5513a1ef tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:27.770888 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-80382cab-1ca1-428f-8f10-b8bd5513a1ef tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:27.778799 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80382cab-1ca1-428f-8f10-b8bd5513a1ef tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:27.779246 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80382cab-1ca1-428f-8f10-b8bd5513a1ef tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:27.780119 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80382cab-1ca1-428f-8f10-b8bd5513a1ef tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:27.780577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-80382cab-1ca1-428f-8f10-b8bd5513a1ef tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:27.996685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-80382cab-1ca1-428f-8f10-b8bd5513a1ef tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:28.006725 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-80382cab-1ca1-428f-8f10-b8bd5513a1ef tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.246241 Dec 16 14:49:28.007324 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 568/1159] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:27 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:29.029512 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-032f1769-d843-492e-ac2f-fc9e7e37c37a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:29.030433 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-032f1769-d843-492e-ac2f-fc9e7e37c37a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:29.038563 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-032f1769-d843-492e-ac2f-fc9e7e37c37a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:29.039014 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-032f1769-d843-492e-ac2f-fc9e7e37c37a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:29.039779 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-032f1769-d843-492e-ac2f-fc9e7e37c37a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:29.040219 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-032f1769-d843-492e-ac2f-fc9e7e37c37a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:29.266306 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-032f1769-d843-492e-ac2f-fc9e7e37c37a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:29.274761 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-032f1769-d843-492e-ac2f-fc9e7e37c37a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1318 microversion: 2.1 time: 0.255038 Dec 16 14:49:29.275311 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 592/1160] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:29 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:30.297189 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7ffbfe77-d0aa-43b1-bf9e-1b7f92af7433 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:30.297832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7ffbfe77-d0aa-43b1-bf9e-1b7f92af7433 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:30.305673 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7ffbfe77-d0aa-43b1-bf9e-1b7f92af7433 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:30.306180 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7ffbfe77-d0aa-43b1-bf9e-1b7f92af7433 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:30.306969 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7ffbfe77-d0aa-43b1-bf9e-1b7f92af7433 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:30.307395 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7ffbfe77-d0aa-43b1-bf9e-1b7f92af7433 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:30.533599 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7ffbfe77-d0aa-43b1-bf9e-1b7f92af7433 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:30.542531 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7ffbfe77-d0aa-43b1-bf9e-1b7f92af7433 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1509 microversion: 2.1 time: 0.255159 Dec 16 14:49:30.543103 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 569/1161] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:30 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:30.568354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-db2f8444-3015-43eb-9123-d48fed2c2d21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccfaf36b-e182-4799-bb3e-dc8dfa9969ed"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:30.569315 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-db2f8444-3015-43eb-9123-d48fed2c2d21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:30.577140 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-db2f8444-3015-43eb-9123-d48fed2c2d21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:30.577578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-db2f8444-3015-43eb-9123-d48fed2c2d21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:30.578388 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-db2f8444-3015-43eb-9123-d48fed2c2d21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:30.578805 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-db2f8444-3015-43eb-9123-d48fed2c2d21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:30.989788 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-db2f8444-3015-43eb-9123-d48fed2c2d21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume ccfaf36b-e182-4799-bb3e-dc8dfa9969ed status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c65557d3-49bd-4d60-8a80-c8953b9b386b) Dec 16 14:49:30.990832 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-db2f8444-3015-43eb-9123-d48fed2c2d21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Returning 400 to user: Invalid input received: Invalid volume: Volume ccfaf36b-e182-4799-bb3e-dc8dfa9969ed status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-c65557d3-49bd-4d60-8a80-c8953b9b386b) {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:49:30.992071 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-db2f8444-3015-43eb-9123-d48fed2c2d21 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "POST /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.434050 Dec 16 14:49:30.992884 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 593/1162] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:49:30 2021] POST /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe/os-volume_attachments => generated 279 bytes in 436 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 16 14:49:31.113379 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4952a8be-33de-4bd0-b378-25ae1d655bcd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:31.113873 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4952a8be-33de-4bd0-b378-25ae1d655bcd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:31.121551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4952a8be-33de-4bd0-b378-25ae1d655bcd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:31.122369 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4952a8be-33de-4bd0-b378-25ae1d655bcd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:31.123491 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4952a8be-33de-4bd0-b378-25ae1d655bcd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:31.123729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4952a8be-33de-4bd0-b378-25ae1d655bcd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:31.387546 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4952a8be-33de-4bd0-b378-25ae1d655bcd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments/ccfaf36b-e182-4799-bb3e-dc8dfa9969ed" status: 202 len: 0 microversion: 2.1 time: 0.284380 Dec 16 14:49:31.388659 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 570/1163] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:49:31 2021] DELETE /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments/ccfaf36b-e182-4799-bb3e-dc8dfa9969ed => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:49:31.404618 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2b85646d-9dad-422d-a3e4-f2d0c2e613b8 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:31.405834 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2b85646d-9dad-422d-a3e4-f2d0c2e613b8 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:31.414265 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2b85646d-9dad-422d-a3e4-f2d0c2e613b8 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:31.414709 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2b85646d-9dad-422d-a3e4-f2d0c2e613b8 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:31.415484 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2b85646d-9dad-422d-a3e4-f2d0c2e613b8 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:31.415902 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2b85646d-9dad-422d-a3e4-f2d0c2e613b8 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:31.494093 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2b85646d-9dad-422d-a3e4-f2d0c2e613b8 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100721 Dec 16 14:49:31.494655 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 594/1164] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:49:31 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:32.515177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a1134654-f4ff-4aca-be5b-b73ff492c2b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:32.516291 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a1134654-f4ff-4aca-be5b-b73ff492c2b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:32.526933 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a1134654-f4ff-4aca-be5b-b73ff492c2b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:32.527551 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a1134654-f4ff-4aca-be5b-b73ff492c2b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:32.528760 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a1134654-f4ff-4aca-be5b-b73ff492c2b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:32.529390 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a1134654-f4ff-4aca-be5b-b73ff492c2b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:32.614390 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a1134654-f4ff-4aca-be5b-b73ff492c2b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110989 Dec 16 14:49:32.615271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 571/1165] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:49:32 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:49:33.633615 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d9f734ff-be0a-464b-98ca-2200cb19563f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:33.634963 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d9f734ff-be0a-464b-98ca-2200cb19563f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:33.643464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9f734ff-be0a-464b-98ca-2200cb19563f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:33.643902 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9f734ff-be0a-464b-98ca-2200cb19563f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:33.644651 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9f734ff-be0a-464b-98ca-2200cb19563f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:33.645080 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d9f734ff-be0a-464b-98ca-2200cb19563f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:33.717104 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d9f734ff-be0a-464b-98ca-2200cb19563f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092839 Dec 16 14:49:33.717664 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 595/1166] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:49:33 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:49:33.955381 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-806595783", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "networks": [{"uuid": "32e1bc01-b84b-4784-8fab-5e9379c8e7dd"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:34.030914 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] validate_networks() for [('32e1bc01-b84b-4784-8fab-5e9379c8e7dd', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:49:34.692509 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:49:34.692932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:49:34.693409 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:49:34.693813 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:49:34.694270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:49:34.703762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:34.704198 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:34.704984 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:34.705413 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:34.723733 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Getting quotas for project eb6df6b44f0d42339c2fd1095ce3bdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:49:34.728303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Getting quotas for user 9a05ec0df9334b0ca96bffdd9fdfe99d and project eb6df6b44f0d42339c2fd1095ce3bdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:49:34.739828 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:49:34.742166 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:49:34.794050 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ebb6eb69-3738-47f5-8ede-d85ff03d9084 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848099 Dec 16 14:49:34.794703 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 572/1167] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:49:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:49:34.811010 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3d3c6ac7-ed4f-49ef-be0b-f31abc718dd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:34.811659 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3d3c6ac7-ed4f-49ef-be0b-f31abc718dd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:34.893743 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3d3c6ac7-ed4f-49ef-be0b-f31abc718dd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:34.902115 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3d3c6ac7-ed4f-49ef-be0b-f31abc718dd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1217 microversion: 2.1 time: 0.101150 Dec 16 14:49:34.902826 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 596/1168] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:34 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:35.924717 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-27b3d0d7-e9c0-4536-849c-9b53efbc22af tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:35.925521 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-27b3d0d7-e9c0-4536-849c-9b53efbc22af tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:35.934311 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-27b3d0d7-e9c0-4536-849c-9b53efbc22af tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:35.934787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-27b3d0d7-e9c0-4536-849c-9b53efbc22af tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:35.935674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-27b3d0d7-e9c0-4536-849c-9b53efbc22af tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:35.936111 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-27b3d0d7-e9c0-4536-849c-9b53efbc22af tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:36.080072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-27b3d0d7-e9c0-4536-849c-9b53efbc22af tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:36.088998 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-27b3d0d7-e9c0-4536-849c-9b53efbc22af tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1269 microversion: 2.1 time: 0.173781 Dec 16 14:49:36.089809 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 573/1169] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:35 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:49:37.115488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-020d3312-e213-4f94-9088-4b1ffa7b1c02 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:37.116747 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-020d3312-e213-4f94-9088-4b1ffa7b1c02 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:37.142831 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-020d3312-e213-4f94-9088-4b1ffa7b1c02 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:37.143767 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-020d3312-e213-4f94-9088-4b1ffa7b1c02 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:37.144718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-020d3312-e213-4f94-9088-4b1ffa7b1c02 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:37.145308 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-020d3312-e213-4f94-9088-4b1ffa7b1c02 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:37.629241 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-020d3312-e213-4f94-9088-4b1ffa7b1c02 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:37.638247 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-020d3312-e213-4f94-9088-4b1ffa7b1c02 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1317 microversion: 2.1 time: 0.532021 Dec 16 14:49:37.638825 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 597/1170] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:37 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:49:38.620847 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-170ef537-00d2-4bd3-a32c-15e9c514b1e8 req-5a93befe-7422-498a-845d-13c9d25cb301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af856ef5-294f-4ede-9c79-9c71de32e0c8", "tag": "7813cbcd-3b61-46af-8c1e-d4b2b84f58c8"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:38.628045 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:49:38.628045 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:49:38.638308 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-170ef537-00d2-4bd3-a32c-15e9c514b1e8 req-5a93befe-7422-498a-845d-13c9d25cb301 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:38.638739 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-170ef537-00d2-4bd3-a32c-15e9c514b1e8 req-5a93befe-7422-498a-845d-13c9d25cb301 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:38.659086 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-170ef537-00d2-4bd3-a32c-15e9c514b1e8 req-5a93befe-7422-498a-845d-13c9d25cb301 service nova] Creating event network-changed:7813cbcd-3b61-46af-8c1e-d4b2b84f58c8 for instance af856ef5-294f-4ede-9c79-9c71de32e0c8 on hv-cinder-82189 Dec 16 14:49:38.662604 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-676be753-fb5a-438e-aec5-82cd10f7a51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:38.663193 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-676be753-fb5a-438e-aec5-82cd10f7a51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:38.664755 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-170ef537-00d2-4bd3-a32c-15e9c514b1e8 req-5a93befe-7422-498a-845d-13c9d25cb301 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.316906 Dec 16 14:49:38.665705 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 574/1171] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:49:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:38.671389 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-676be753-fb5a-438e-aec5-82cd10f7a51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:38.672123 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-676be753-fb5a-438e-aec5-82cd10f7a51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:38.672907 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-676be753-fb5a-438e-aec5-82cd10f7a51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:38.673335 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-676be753-fb5a-438e-aec5-82cd10f7a51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:39.178110 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-676be753-fb5a-438e-aec5-82cd10f7a51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:39.187573 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-676be753-fb5a-438e-aec5-82cd10f7a51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1317 microversion: 2.1 time: 0.535386 Dec 16 14:49:39.188598 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 598/1172] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:38 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:40.210817 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3136d418-8f9c-4331-bd66-ffb87d7efc4e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:40.211582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3136d418-8f9c-4331-bd66-ffb87d7efc4e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:40.220052 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3136d418-8f9c-4331-bd66-ffb87d7efc4e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:40.220840 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3136d418-8f9c-4331-bd66-ffb87d7efc4e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:40.221265 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3136d418-8f9c-4331-bd66-ffb87d7efc4e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:40.221674 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-3136d418-8f9c-4331-bd66-ffb87d7efc4e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:40.473374 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3136d418-8f9c-4331-bd66-ffb87d7efc4e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:40.482327 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3136d418-8f9c-4331-bd66-ffb87d7efc4e tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1317 microversion: 2.1 time: 0.281230 Dec 16 14:49:40.482892 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 575/1173] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:40 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:41.505852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9f76d6f5-96d5-48ce-8b1a-21406d913f67 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:41.506545 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9f76d6f5-96d5-48ce-8b1a-21406d913f67 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:41.514982 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f76d6f5-96d5-48ce-8b1a-21406d913f67 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:41.515422 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f76d6f5-96d5-48ce-8b1a-21406d913f67 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:41.516192 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f76d6f5-96d5-48ce-8b1a-21406d913f67 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:41.516615 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9f76d6f5-96d5-48ce-8b1a-21406d913f67 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:41.738923 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9f76d6f5-96d5-48ce-8b1a-21406d913f67 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:41.748268 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9f76d6f5-96d5-48ce-8b1a-21406d913f67 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1317 microversion: 2.1 time: 0.251728 Dec 16 14:49:41.748807 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 599/1174] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:41 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:42.771693 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5033d282-9662-4436-a563-396dda50aa38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:42.772276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5033d282-9662-4436-a563-396dda50aa38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:42.780584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5033d282-9662-4436-a563-396dda50aa38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:42.781035 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5033d282-9662-4436-a563-396dda50aa38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:42.781833 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5033d282-9662-4436-a563-396dda50aa38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:42.782280 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5033d282-9662-4436-a563-396dda50aa38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:43.017834 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5033d282-9662-4436-a563-396dda50aa38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:43.026903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5033d282-9662-4436-a563-396dda50aa38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1317 microversion: 2.1 time: 0.264738 Dec 16 14:49:43.027386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 576/1175] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:42 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:44.049475 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8ffc6cf6-047d-4cbd-9bce-ea4098ee3d74 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:44.050169 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8ffc6cf6-047d-4cbd-9bce-ea4098ee3d74 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:44.058769 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8ffc6cf6-047d-4cbd-9bce-ea4098ee3d74 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:44.059248 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8ffc6cf6-047d-4cbd-9bce-ea4098ee3d74 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:44.060008 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8ffc6cf6-047d-4cbd-9bce-ea4098ee3d74 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:44.060457 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8ffc6cf6-047d-4cbd-9bce-ea4098ee3d74 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:44.272894 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8ffc6cf6-047d-4cbd-9bce-ea4098ee3d74 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:44.282841 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8ffc6cf6-047d-4cbd-9bce-ea4098ee3d74 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1317 microversion: 2.1 time: 0.242991 Dec 16 14:49:44.283371 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 600/1176] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:44 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:45.316731 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-42f6702e-6469-4eed-bb6f-0868027b0994 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:45.317490 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-42f6702e-6469-4eed-bb6f-0868027b0994 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:45.325907 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-42f6702e-6469-4eed-bb6f-0868027b0994 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:45.326566 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-42f6702e-6469-4eed-bb6f-0868027b0994 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:45.327524 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-42f6702e-6469-4eed-bb6f-0868027b0994 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:45.328078 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-42f6702e-6469-4eed-bb6f-0868027b0994 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:45.406715 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-0fbd73d8-1f9b-47cd-9dcd-395f53a79497 req-156f5169-dbe7-47c8-a82f-afce6c302603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af856ef5-294f-4ede-9c79-9c71de32e0c8", "name": "network-vif-plugged", "status": "completed", "tag": "7813cbcd-3b61-46af-8c1e-d4b2b84f58c8"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:45.413904 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:49:45.413904 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:49:45.423442 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-0fbd73d8-1f9b-47cd-9dcd-395f53a79497 req-156f5169-dbe7-47c8-a82f-afce6c302603 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:45.423799 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-0fbd73d8-1f9b-47cd-9dcd-395f53a79497 req-156f5169-dbe7-47c8-a82f-afce6c302603 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:45.441201 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-0fbd73d8-1f9b-47cd-9dcd-395f53a79497 req-156f5169-dbe7-47c8-a82f-afce6c302603 service nova] Creating event network-vif-plugged:7813cbcd-3b61-46af-8c1e-d4b2b84f58c8 for instance af856ef5-294f-4ede-9c79-9c71de32e0c8 on hv-cinder-82189 Dec 16 14:49:45.446450 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-0fbd73d8-1f9b-47cd-9dcd-395f53a79497 req-156f5169-dbe7-47c8-a82f-afce6c302603 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051459 Dec 16 14:49:45.447448 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 601/1177] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:49:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:49:45.551907 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-42f6702e-6469-4eed-bb6f-0868027b0994 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:45.561825 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-42f6702e-6469-4eed-bb6f-0868027b0994 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1317 microversion: 2.1 time: 0.264276 Dec 16 14:49:45.562443 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 577/1178] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:45 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:46.586197 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-dbaea7bc-44f3-41f8-8446-123a90228723 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:46.587694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-dbaea7bc-44f3-41f8-8446-123a90228723 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:46.595368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dbaea7bc-44f3-41f8-8446-123a90228723 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:46.595818 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dbaea7bc-44f3-41f8-8446-123a90228723 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:46.596658 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dbaea7bc-44f3-41f8-8446-123a90228723 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:46.597061 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-dbaea7bc-44f3-41f8-8446-123a90228723 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:46.813418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-dbaea7bc-44f3-41f8-8446-123a90228723 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:46.822163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-dbaea7bc-44f3-41f8-8446-123a90228723 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1317 microversion: 2.1 time: 0.246249 Dec 16 14:49:46.822751 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 602/1179] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:46 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:47.846792 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6407a2c5-31e1-4651-9c35-60af5025f9a5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:47.847436 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6407a2c5-31e1-4651-9c35-60af5025f9a5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:47.856708 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6407a2c5-31e1-4651-9c35-60af5025f9a5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:47.857155 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6407a2c5-31e1-4651-9c35-60af5025f9a5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:47.857932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6407a2c5-31e1-4651-9c35-60af5025f9a5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:47.858402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-6407a2c5-31e1-4651-9c35-60af5025f9a5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:48.083582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6407a2c5-31e1-4651-9c35-60af5025f9a5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:49:48.093445 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6407a2c5-31e1-4651-9c35-60af5025f9a5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1507 microversion: 2.1 time: 0.256667 Dec 16 14:49:48.098415 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 578/1180] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:47 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:49.695719 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d78bdb8e-62d1-4a55-b1d8-1299e5ebe216 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee501d0f-9f64-4912-acf4-e91b42a16f51"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:49.696629 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d78bdb8e-62d1-4a55-b1d8-1299e5ebe216 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:49.704974 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d78bdb8e-62d1-4a55-b1d8-1299e5ebe216 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:49.705391 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d78bdb8e-62d1-4a55-b1d8-1299e5ebe216 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:49.706210 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d78bdb8e-62d1-4a55-b1d8-1299e5ebe216 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:49.706621 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-d78bdb8e-62d1-4a55-b1d8-1299e5ebe216 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:50.147603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d78bdb8e-62d1-4a55-b1d8-1299e5ebe216 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "POST /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461374 Dec 16 14:49:50.149400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 603/1181] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:49:49 2021] POST /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:58.098296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7b9ee91c-1842-473f-b496-18d5db864577 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee501d0f-9f64-4912-acf4-e91b42a16f51"}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:58.099746 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7b9ee91c-1842-473f-b496-18d5db864577 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:58.114023 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b9ee91c-1842-473f-b496-18d5db864577 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:58.114625 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b9ee91c-1842-473f-b496-18d5db864577 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:58.115404 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b9ee91c-1842-473f-b496-18d5db864577 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:58.115823 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7b9ee91c-1842-473f-b496-18d5db864577 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:58.187498 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-7b9ee91c-1842-473f-b496-18d5db864577 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] HTTP exception thrown: Invalid volume: volume ee501d0f-9f64-4912-acf4-e91b42a16f51 already attached Dec 16 14:49:58.188088 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7b9ee91c-1842-473f-b496-18d5db864577 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Returning 400 to user: Invalid volume: volume ee501d0f-9f64-4912-acf4-e91b42a16f51 already attached {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:49:58.188903 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7b9ee91c-1842-473f-b496-18d5db864577 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "POST /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.100286 Dec 16 14:49:58.189467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 579/1182] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:49:58 2021] POST /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments => generated 120 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 16 14:49:58.313367 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5ce2b25c-3747-46cc-ad7d-090a3a9c720d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:58.314060 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5ce2b25c-3747-46cc-ad7d-090a3a9c720d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:58.325024 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5ce2b25c-3747-46cc-ad7d-090a3a9c720d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:58.325470 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5ce2b25c-3747-46cc-ad7d-090a3a9c720d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:58.326290 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5ce2b25c-3747-46cc-ad7d-090a3a9c720d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:58.326728 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5ce2b25c-3747-46cc-ad7d-090a3a9c720d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:58.617372 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5ce2b25c-3747-46cc-ad7d-090a3a9c720d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "DELETE /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments/ee501d0f-9f64-4912-acf4-e91b42a16f51" status: 202 len: 0 microversion: 2.1 time: 0.315512 Dec 16 14:49:58.617961 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 604/1183] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:49:58 2021] DELETE /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments/ee501d0f-9f64-4912-acf4-e91b42a16f51 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:49:58.632380 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f0e2ef8e-462a-45cd-aeb5-fa4fa71341dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:58.633432 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f0e2ef8e-462a-45cd-aeb5-fa4fa71341dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:58.641962 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0e2ef8e-462a-45cd-aeb5-fa4fa71341dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:58.642445 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0e2ef8e-462a-45cd-aeb5-fa4fa71341dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:58.643234 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0e2ef8e-462a-45cd-aeb5-fa4fa71341dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:58.643662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f0e2ef8e-462a-45cd-aeb5-fa4fa71341dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:58.717347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f0e2ef8e-462a-45cd-aeb5-fa4fa71341dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094599 Dec 16 14:49:58.717854 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 580/1184] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:49:58 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:59.735770 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-53218705-dfcd-448e-ad1e-b1c1a3d71a71 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:59.736833 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-53218705-dfcd-448e-ad1e-b1c1a3d71a71 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:49:59.744629 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-53218705-dfcd-448e-ad1e-b1c1a3d71a71 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:59.745079 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-53218705-dfcd-448e-ad1e-b1c1a3d71a71 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:59.745855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-53218705-dfcd-448e-ad1e-b1c1a3d71a71 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:59.746314 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-53218705-dfcd-448e-ad1e-b1c1a3d71a71 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:59.823291 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-53218705-dfcd-448e-ad1e-b1c1a3d71a71 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097872 Dec 16 14:49:59.823909 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 605/1185] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:49:59 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:00.843403 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4156d016-565e-4b0e-9d51-1d30d50fb4b6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:00.844779 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4156d016-565e-4b0e-9d51-1d30d50fb4b6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:00.857549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4156d016-565e-4b0e-9d51-1d30d50fb4b6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:00.858600 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4156d016-565e-4b0e-9d51-1d30d50fb4b6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:00.859810 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4156d016-565e-4b0e-9d51-1d30d50fb4b6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:00.860511 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4156d016-565e-4b0e-9d51-1d30d50fb4b6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:00.932347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4156d016-565e-4b0e-9d51-1d30d50fb4b6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099056 Dec 16 14:50:00.932915 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 581/1186] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:50:00 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:01.104510 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1606139532", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452", "networks": [{"uuid": "32e1bc01-b84b-4784-8fab-5e9379c8e7dd"}]}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:01.182709 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.network.neutron [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] validate_networks() for [('32e1bc01-b84b-4784-8fab-5e9379c8e7dd', None, None, None)] {{(pid=96670) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:50:01.737312 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Flavor limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:50:01.738092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Image limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:50:01.738484 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Flavor pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:50:01.738753 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Image pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:50:01.739150 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:50:01.748651 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:01.749418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:01.750846 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:01.751501 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:01.770190 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Getting quotas for project eb6df6b44f0d42339c2fd1095ce3bdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:50:01.774558 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Getting quotas for user 9a05ec0df9334b0ca96bffdd9fdfe99d and project eb6df6b44f0d42339c2fd1095ce3bdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:50:01.785473 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Going to run 1 instances... {{(pid=96670) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:50:01.787864 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:50:01.835219 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ed02cfe3-22e5-4267-90e6-4fffdca4aeeb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740926 Dec 16 14:50:01.835883 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 606/1187] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:50:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:50:01.853595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a7c2c28b-1081-458b-a1e0-cb059801b59f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:01.854284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a7c2c28b-1081-458b-a1e0-cb059801b59f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:01.968856 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a7c2c28b-1081-458b-a1e0-cb059801b59f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:01.977310 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a7c2c28b-1081-458b-a1e0-cb059801b59f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1218 microversion: 2.1 time: 0.134878 Dec 16 14:50:01.977872 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 582/1188] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:01 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:03.003391 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-96bb0df6-ba55-4268-857a-19d1dbf5725c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:03.004279 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-96bb0df6-ba55-4268-857a-19d1dbf5725c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:03.015923 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-96bb0df6-ba55-4268-857a-19d1dbf5725c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:03.016400 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-96bb0df6-ba55-4268-857a-19d1dbf5725c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:03.017155 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-96bb0df6-ba55-4268-857a-19d1dbf5725c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:03.017655 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-96bb0df6-ba55-4268-857a-19d1dbf5725c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:03.156647 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-96bb0df6-ba55-4268-857a-19d1dbf5725c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:03.165593 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-96bb0df6-ba55-4268-857a-19d1dbf5725c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1270 microversion: 2.1 time: 0.174147 Dec 16 14:50:03.166198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 607/1189] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:02 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:04.188835 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b2887598-e370-407d-8ccf-acb6143a9317 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:04.189611 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b2887598-e370-407d-8ccf-acb6143a9317 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:04.198813 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b2887598-e370-407d-8ccf-acb6143a9317 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:04.199251 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b2887598-e370-407d-8ccf-acb6143a9317 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:04.200026 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b2887598-e370-407d-8ccf-acb6143a9317 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:04.200458 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b2887598-e370-407d-8ccf-acb6143a9317 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:04.460307 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b2887598-e370-407d-8ccf-acb6143a9317 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:04.470151 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b2887598-e370-407d-8ccf-acb6143a9317 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.290921 Dec 16 14:50:04.470714 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 583/1190] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:04 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:05.422345 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-e288f7a0-2fef-4567-a272-290b54c39f24 req-73cb212f-4c70-456c-9a97-35baeadcd9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd30dc7f-7d75-465f-80a8-0d2912f9f543", "tag": "c4994259-c227-42f5-9789-dff779f51194"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:05.430481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:05.430481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:50:05.444193 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-e288f7a0-2fef-4567-a272-290b54c39f24 req-73cb212f-4c70-456c-9a97-35baeadcd9aa service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:05.444994 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-e288f7a0-2fef-4567-a272-290b54c39f24 req-73cb212f-4c70-456c-9a97-35baeadcd9aa service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:05.471492 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-e288f7a0-2fef-4567-a272-290b54c39f24 req-73cb212f-4c70-456c-9a97-35baeadcd9aa service nova] Creating event network-changed:c4994259-c227-42f5-9789-dff779f51194 for instance dd30dc7f-7d75-465f-80a8-0d2912f9f543 on hv-cinder-82189 Dec 16 14:50:05.476102 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-e288f7a0-2fef-4567-a272-290b54c39f24 req-73cb212f-4c70-456c-9a97-35baeadcd9aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062979 Dec 16 14:50:05.476694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 608/1191] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:05.493276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-be38a8ed-8e1f-4e11-8140-ed22109fffdb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:05.494208 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-be38a8ed-8e1f-4e11-8140-ed22109fffdb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:05.501803 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be38a8ed-8e1f-4e11-8140-ed22109fffdb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:05.502458 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be38a8ed-8e1f-4e11-8140-ed22109fffdb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:05.503240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be38a8ed-8e1f-4e11-8140-ed22109fffdb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:05.503672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be38a8ed-8e1f-4e11-8140-ed22109fffdb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:05.714191 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-be38a8ed-8e1f-4e11-8140-ed22109fffdb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:05.723040 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-be38a8ed-8e1f-4e11-8140-ed22109fffdb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.239180 Dec 16 14:50:05.723515 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 584/1192] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:05 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:06.747490 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-14a275e9-b103-43b0-9155-51d7b30e37c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:06.748200 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-14a275e9-b103-43b0-9155-51d7b30e37c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:06.756212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-14a275e9-b103-43b0-9155-51d7b30e37c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:06.756694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-14a275e9-b103-43b0-9155-51d7b30e37c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:06.758085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-14a275e9-b103-43b0-9155-51d7b30e37c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:06.758085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-14a275e9-b103-43b0-9155-51d7b30e37c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:07.058370 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-14a275e9-b103-43b0-9155-51d7b30e37c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:07.073629 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-14a275e9-b103-43b0-9155-51d7b30e37c7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.336386 Dec 16 14:50:07.074368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 609/1193] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:06 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:08.100276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-44d4054b-b1da-4a54-96c9-9ad7654f7aaf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:08.100860 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-44d4054b-b1da-4a54-96c9-9ad7654f7aaf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:08.109941 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-44d4054b-b1da-4a54-96c9-9ad7654f7aaf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:08.110647 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-44d4054b-b1da-4a54-96c9-9ad7654f7aaf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:08.111437 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-44d4054b-b1da-4a54-96c9-9ad7654f7aaf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:08.111854 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-44d4054b-b1da-4a54-96c9-9ad7654f7aaf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:08.331355 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-44d4054b-b1da-4a54-96c9-9ad7654f7aaf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:08.340176 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-44d4054b-b1da-4a54-96c9-9ad7654f7aaf tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.249289 Dec 16 14:50:08.340728 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 585/1194] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:08 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:09.364230 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-62b5e3f0-9c9d-40c5-b6b0-283f7578de62 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:09.364852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-62b5e3f0-9c9d-40c5-b6b0-283f7578de62 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:09.376048 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-62b5e3f0-9c9d-40c5-b6b0-283f7578de62 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:09.376526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-62b5e3f0-9c9d-40c5-b6b0-283f7578de62 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:09.377430 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-62b5e3f0-9c9d-40c5-b6b0-283f7578de62 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:09.377906 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-62b5e3f0-9c9d-40c5-b6b0-283f7578de62 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:09.590602 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-62b5e3f0-9c9d-40c5-b6b0-283f7578de62 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:09.599276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-62b5e3f0-9c9d-40c5-b6b0-283f7578de62 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.245592 Dec 16 14:50:09.599820 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 610/1195] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:09 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:10.623332 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-dd993494-3ffa-4f2f-9021-b0cd7d1de5a2 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:10.623970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-dd993494-3ffa-4f2f-9021-b0cd7d1de5a2 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:10.639661 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dd993494-3ffa-4f2f-9021-b0cd7d1de5a2 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.640378 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dd993494-3ffa-4f2f-9021-b0cd7d1de5a2 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:10.641595 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dd993494-3ffa-4f2f-9021-b0cd7d1de5a2 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.642043 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-dd993494-3ffa-4f2f-9021-b0cd7d1de5a2 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:10.864554 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-dd993494-3ffa-4f2f-9021-b0cd7d1de5a2 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:10.873230 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-dd993494-3ffa-4f2f-9021-b0cd7d1de5a2 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.260498 Dec 16 14:50:10.873815 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 586/1196] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:10 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:11.895610 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-335ebb63-3961-48d3-8b70-79e85ee9cd38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:11.896280 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-335ebb63-3961-48d3-8b70-79e85ee9cd38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:11.904078 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-335ebb63-3961-48d3-8b70-79e85ee9cd38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:11.904519 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-335ebb63-3961-48d3-8b70-79e85ee9cd38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:11.905284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-335ebb63-3961-48d3-8b70-79e85ee9cd38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:11.905684 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-335ebb63-3961-48d3-8b70-79e85ee9cd38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:12.129599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-335ebb63-3961-48d3-8b70-79e85ee9cd38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:12.139284 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-335ebb63-3961-48d3-8b70-79e85ee9cd38 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.253336 Dec 16 14:50:12.140667 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 611/1197] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:11 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:13.162726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1c1ebd38-adda-4ac5-b52a-ddad93fa9fcb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:13.163336 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1c1ebd38-adda-4ac5-b52a-ddad93fa9fcb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:13.171599 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1c1ebd38-adda-4ac5-b52a-ddad93fa9fcb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:13.172048 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1c1ebd38-adda-4ac5-b52a-ddad93fa9fcb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:13.172839 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1c1ebd38-adda-4ac5-b52a-ddad93fa9fcb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:13.173296 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1c1ebd38-adda-4ac5-b52a-ddad93fa9fcb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:13.382951 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1c1ebd38-adda-4ac5-b52a-ddad93fa9fcb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:13.391643 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1c1ebd38-adda-4ac5-b52a-ddad93fa9fcb tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.238595 Dec 16 14:50:13.392231 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 587/1198] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:13 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:13.616189 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-45b527b8-ba2e-48c2-87a5-5627a735069a req-8904ab6b-9d61-4332-8b94-20bc27825223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd30dc7f-7d75-465f-80a8-0d2912f9f543", "name": "network-vif-plugged", "status": "completed", "tag": "c4994259-c227-42f5-9789-dff779f51194"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:13.622910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:13.622910 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:50:13.632343 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-45b527b8-ba2e-48c2-87a5-5627a735069a req-8904ab6b-9d61-4332-8b94-20bc27825223 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:13.632791 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-45b527b8-ba2e-48c2-87a5-5627a735069a req-8904ab6b-9d61-4332-8b94-20bc27825223 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:13.648693 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-45b527b8-ba2e-48c2-87a5-5627a735069a req-8904ab6b-9d61-4332-8b94-20bc27825223 service nova] Creating event network-vif-plugged:c4994259-c227-42f5-9789-dff779f51194 for instance dd30dc7f-7d75-465f-80a8-0d2912f9f543 on hv-cinder-82189 Dec 16 14:50:13.653483 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-45b527b8-ba2e-48c2-87a5-5627a735069a req-8904ab6b-9d61-4332-8b94-20bc27825223 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136804 Dec 16 14:50:13.654267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 612/1199] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:14.414628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8d61fbb5-794b-476a-ab14-1b1823676447 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:14.415287 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8d61fbb5-794b-476a-ab14-1b1823676447 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:14.423658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d61fbb5-794b-476a-ab14-1b1823676447 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:14.424104 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d61fbb5-794b-476a-ab14-1b1823676447 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:14.424856 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d61fbb5-794b-476a-ab14-1b1823676447 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:14.425298 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8d61fbb5-794b-476a-ab14-1b1823676447 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:14.643618 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8d61fbb5-794b-476a-ab14-1b1823676447 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:14.652754 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8d61fbb5-794b-476a-ab14-1b1823676447 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.248091 Dec 16 14:50:14.653304 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 588/1200] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:14 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:15.675759 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-36e0f08c-7bc3-49e4-ac69-251767442df3 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:15.676421 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-36e0f08c-7bc3-49e4-ac69-251767442df3 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:15.684625 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-36e0f08c-7bc3-49e4-ac69-251767442df3 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:15.685073 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-36e0f08c-7bc3-49e4-ac69-251767442df3 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:15.685926 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-36e0f08c-7bc3-49e4-ac69-251767442df3 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:15.686502 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-36e0f08c-7bc3-49e4-ac69-251767442df3 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:15.920025 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-36e0f08c-7bc3-49e4-ac69-251767442df3 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:15.928943 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-36e0f08c-7bc3-49e4-ac69-251767442df3 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1318 microversion: 2.1 time: 0.263094 Dec 16 14:50:15.929420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 613/1201] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:15 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:16.952529 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ce3a6494-4d57-4312-a2e8-a609842b3e3d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:16.953130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ce3a6494-4d57-4312-a2e8-a609842b3e3d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:16.961029 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce3a6494-4d57-4312-a2e8-a609842b3e3d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:16.961477 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce3a6494-4d57-4312-a2e8-a609842b3e3d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:16.962285 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce3a6494-4d57-4312-a2e8-a609842b3e3d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:16.962720 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce3a6494-4d57-4312-a2e8-a609842b3e3d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:17.174481 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ce3a6494-4d57-4312-a2e8-a609842b3e3d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:17.183362 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ce3a6494-4d57-4312-a2e8-a609842b3e3d tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1508 microversion: 2.1 time: 0.240403 Dec 16 14:50:17.183913 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 589/1202] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:16 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:18.775720 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0891b7b9-22be-4fbf-8292-38babed6dbf7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6a99347-d4fd-4483-a4b7-5fc667090cb6"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:18.776769 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0891b7b9-22be-4fbf-8292-38babed6dbf7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:18.784562 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0891b7b9-22be-4fbf-8292-38babed6dbf7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:18.784983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0891b7b9-22be-4fbf-8292-38babed6dbf7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:18.785746 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0891b7b9-22be-4fbf-8292-38babed6dbf7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:18.786193 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0891b7b9-22be-4fbf-8292-38babed6dbf7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:19.191465 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0891b7b9-22be-4fbf-8292-38babed6dbf7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "POST /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424857 Dec 16 14:50:19.191943 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 614/1203] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Dec 16 14:50:18 2021] POST /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:27.318613 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d32fff49-85a4-4201-a66b-062b0efbc001 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:27.319243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d32fff49-85a4-4201-a66b-062b0efbc001 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:27.327105 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d32fff49-85a4-4201-a66b-062b0efbc001 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:27.327534 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d32fff49-85a4-4201-a66b-062b0efbc001 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:27.328909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d32fff49-85a4-4201-a66b-062b0efbc001 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:27.328909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d32fff49-85a4-4201-a66b-062b0efbc001 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:27.597934 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d32fff49-85a4-4201-a66b-062b0efbc001 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments/e6a99347-d4fd-4483-a4b7-5fc667090cb6" status: 202 len: 0 microversion: 2.1 time: 0.288751 Dec 16 14:50:27.598665 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 590/1204] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Dec 16 14:50:27 2021] DELETE /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments/e6a99347-d4fd-4483-a4b7-5fc667090cb6 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:50:27.615267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7e06d191-b9e5-4f54-b265-55eabbb0464a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:27.616235 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7e06d191-b9e5-4f54-b265-55eabbb0464a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:27.625172 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7e06d191-b9e5-4f54-b265-55eabbb0464a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:27.625613 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7e06d191-b9e5-4f54-b265-55eabbb0464a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:27.626429 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7e06d191-b9e5-4f54-b265-55eabbb0464a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:27.626848 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7e06d191-b9e5-4f54-b265-55eabbb0464a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:27.699950 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7e06d191-b9e5-4f54-b265-55eabbb0464a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096104 Dec 16 14:50:27.700582 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 615/1205] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:50:27 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:28.720129 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-14b914f7-bf59-426b-a7d9-81315ea2fe6b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:28.721455 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-14b914f7-bf59-426b-a7d9-81315ea2fe6b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:28.731109 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-14b914f7-bf59-426b-a7d9-81315ea2fe6b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:28.731584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-14b914f7-bf59-426b-a7d9-81315ea2fe6b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:28.732371 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-14b914f7-bf59-426b-a7d9-81315ea2fe6b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:28.733481 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-14b914f7-bf59-426b-a7d9-81315ea2fe6b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:28.806026 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-14b914f7-bf59-426b-a7d9-81315ea2fe6b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096618 Dec 16 14:50:28.806621 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 591/1206] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:50:28 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:29.824481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f851cbb0-c2f8-4713-995e-aa93513a76df tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:29.825526 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f851cbb0-c2f8-4713-995e-aa93513a76df tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:29.833603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f851cbb0-c2f8-4713-995e-aa93513a76df tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:29.834069 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f851cbb0-c2f8-4713-995e-aa93513a76df tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:29.834845 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f851cbb0-c2f8-4713-995e-aa93513a76df tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:29.835311 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f851cbb0-c2f8-4713-995e-aa93513a76df tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:29.909234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f851cbb0-c2f8-4713-995e-aa93513a76df tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094687 Dec 16 14:50:29.909801 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 616/1207] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Dec 16 14:50:29 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:31.257939 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-0cceef91-616d-4424-8364-9c9ec075c51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:31.258614 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0cceef91-616d-4424-8364-9c9ec075c51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:31.268548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0cceef91-616d-4424-8364-9c9ec075c51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:31.268984 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0cceef91-616d-4424-8364-9c9ec075c51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:31.269753 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0cceef91-616d-4424-8364-9c9ec075c51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:31.270205 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-0cceef91-616d-4424-8364-9c9ec075c51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:31.338492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-0cceef91-616d-4424-8364-9c9ec075c51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:50:31.468243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-0cceef91-616d-4424-8364-9c9ec075c51c tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 204 len: 0 microversion: 2.1 time: 0.219336 Dec 16 14:50:31.468843 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 592/1208] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:50:31 2021] DELETE /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:50:31.482843 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1ee6f0b6-5a4b-4032-9625-80a75171bcd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:31.483443 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1ee6f0b6-5a4b-4032-9625-80a75171bcd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:31.490842 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ee6f0b6-5a4b-4032-9625-80a75171bcd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:31.491278 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ee6f0b6-5a4b-4032-9625-80a75171bcd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:31.492026 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ee6f0b6-5a4b-4032-9625-80a75171bcd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:31.492447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ee6f0b6-5a4b-4032-9625-80a75171bcd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:31.712766 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-1ee6f0b6-5a4b-4032-9625-80a75171bcd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:31.722595 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1ee6f0b6-5a4b-4032-9625-80a75171bcd4 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1514 microversion: 2.1 time: 0.249052 Dec 16 14:50:31.723141 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 617/1209] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:31 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:32.747426 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-254851dd-8633-4a3c-a195-fed7d33b29d6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:32.748082 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-254851dd-8633-4a3c-a195-fed7d33b29d6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:32.756177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-254851dd-8633-4a3c-a195-fed7d33b29d6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:32.756607 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-254851dd-8633-4a3c-a195-fed7d33b29d6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:32.757402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-254851dd-8633-4a3c-a195-fed7d33b29d6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:32.757817 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-254851dd-8633-4a3c-a195-fed7d33b29d6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:32.987636 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-254851dd-8633-4a3c-a195-fed7d33b29d6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:33.000971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-254851dd-8633-4a3c-a195-fed7d33b29d6 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1514 microversion: 2.1 time: 0.261634 Dec 16 14:50:33.000971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 593/1210] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:32 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:34.030497 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f54f8e9b-1b94-41b9-b122-937508a8bdea tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:34.031171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f54f8e9b-1b94-41b9-b122-937508a8bdea tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:34.039428 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f54f8e9b-1b94-41b9-b122-937508a8bdea tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:34.039873 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f54f8e9b-1b94-41b9-b122-937508a8bdea tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:34.040653 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f54f8e9b-1b94-41b9-b122-937508a8bdea tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:34.041664 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f54f8e9b-1b94-41b9-b122-937508a8bdea tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:34.555118 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f54f8e9b-1b94-41b9-b122-937508a8bdea tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:34.564843 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f54f8e9b-1b94-41b9-b122-937508a8bdea tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1514 microversion: 2.1 time: 0.544011 Dec 16 14:50:34.565533 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 618/1211] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:34 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1514 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:34.979764 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-53a8bc15-fc94-43a3-983b-b8b429c4ea98 req-025d56b4-37db-48b8-a729-badc7a2795ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd30dc7f-7d75-465f-80a8-0d2912f9f543", "name": "network-vif-deleted", "tag": "c4994259-c227-42f5-9789-dff779f51194"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:34.992464 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:34.992464 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:50:35.002050 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-53a8bc15-fc94-43a3-983b-b8b429c4ea98 req-025d56b4-37db-48b8-a729-badc7a2795ba service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:35.002498 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-53a8bc15-fc94-43a3-983b-b8b429c4ea98 req-025d56b4-37db-48b8-a729-badc7a2795ba service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:35.020469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-53a8bc15-fc94-43a3-983b-b8b429c4ea98 req-025d56b4-37db-48b8-a729-badc7a2795ba service nova] Creating event network-vif-deleted:c4994259-c227-42f5-9789-dff779f51194 for instance dd30dc7f-7d75-465f-80a8-0d2912f9f543 on hv-cinder-82189 Dec 16 14:50:35.025977 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-53a8bc15-fc94-43a3-983b-b8b429c4ea98 req-025d56b4-37db-48b8-a729-badc7a2795ba service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056672 Dec 16 14:50:35.026625 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 594/1212] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:35.590171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:35.590748 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:35.598814 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:35.599273 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:35.600046 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:35.600463 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:35.681740 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:35.682111 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:35.682578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lazy-loading 'fault' on Instance uuid dd30dc7f-7d75-465f-80a8-0d2912f9f543 {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:50:35.765171 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:35.772922 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0e3fa49c-2ecf-46ad-9766-182755d18f17 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 200 len: 1308 microversion: 2.1 time: 0.194005 Dec 16 14:50:35.773489 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 619/1213] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:35 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:36.796190 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ce12f212-694c-4bcc-b64b-dc226bafc883 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:36.796930 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ce12f212-694c-4bcc-b64b-dc226bafc883 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dd30dc7f-7d75-465f-80a8-0d2912f9f543] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:36.805376 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce12f212-694c-4bcc-b64b-dc226bafc883 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:36.805905 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce12f212-694c-4bcc-b64b-dc226bafc883 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:36.806687 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce12f212-694c-4bcc-b64b-dc226bafc883 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:36.807106 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ce12f212-694c-4bcc-b64b-dc226bafc883 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:36.861941 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-ce12f212-694c-4bcc-b64b-dc226bafc883 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] HTTP exception thrown: Instance dd30dc7f-7d75-465f-80a8-0d2912f9f543 could not be found. Dec 16 14:50:36.862662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ce12f212-694c-4bcc-b64b-dc226bafc883 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Returning 404 to user: Instance dd30dc7f-7d75-465f-80a8-0d2912f9f543 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:36.863492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ce12f212-694c-4bcc-b64b-dc226bafc883 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543" status: 404 len: 111 microversion: 2.1 time: 0.077418 Dec 16 14:50:36.864046 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 595/1214] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:36 2021] GET /compute/v2.1/servers/dd30dc7f-7d75-465f-80a8-0d2912f9f543 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:50:38.116668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3523a761-8967-4978-8c61-8b36c535c37b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:38.117356 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3523a761-8967-4978-8c61-8b36c535c37b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:38.125112 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3523a761-8967-4978-8c61-8b36c535c37b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.125562 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3523a761-8967-4978-8c61-8b36c535c37b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.126435 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3523a761-8967-4978-8c61-8b36c535c37b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.126891 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3523a761-8967-4978-8c61-8b36c535c37b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.197475 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3523a761-8967-4978-8c61-8b36c535c37b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Going to try to terminate instance {{(pid=96670) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:50:38.317246 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3523a761-8967-4978-8c61-8b36c535c37b tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "DELETE /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 204 len: 0 microversion: 2.1 time: 0.209512 Dec 16 14:50:38.317708 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 620/1215] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:50:38 2021] DELETE /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:50:38.334922 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-086c3fdd-f4ad-4951-ac9f-81d6112339ff tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:38.335722 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-086c3fdd-f4ad-4951-ac9f-81d6112339ff tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:38.344269 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-086c3fdd-f4ad-4951-ac9f-81d6112339ff tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.344709 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-086c3fdd-f4ad-4951-ac9f-81d6112339ff tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.345476 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-086c3fdd-f4ad-4951-ac9f-81d6112339ff tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.345897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-086c3fdd-f4ad-4951-ac9f-81d6112339ff tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.554184 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-086c3fdd-f4ad-4951-ac9f-81d6112339ff tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:38.562850 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-339210a7-11f5-4697-8f37-6f8959ae8cde tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:38.563041 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-086c3fdd-f4ad-4951-ac9f-81d6112339ff tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1513 microversion: 2.1 time: 0.240068 Dec 16 14:50:38.563401 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 596/1216] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:38 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:50:38.563939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-339210a7-11f5-4697-8f37-6f8959ae8cde tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:38.571741 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-339210a7-11f5-4697-8f37-6f8959ae8cde tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.572099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-339210a7-11f5-4697-8f37-6f8959ae8cde tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.572886 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-339210a7-11f5-4697-8f37-6f8959ae8cde tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.573310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-339210a7-11f5-4697-8f37-6f8959ae8cde tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.644868 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-339210a7-11f5-4697-8f37-6f8959ae8cde tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092045 Dec 16 14:50:38.645429 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 621/1217] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Dec 16 14:50:38 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:38.751754 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7f6f86f1-aadc-41ae-8e6b-ae58179fe520 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:38.752227 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7f6f86f1-aadc-41ae-8e6b-ae58179fe520 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:38.768278 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7f6f86f1-aadc-41ae-8e6b-ae58179fe520 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.768738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7f6f86f1-aadc-41ae-8e6b-ae58179fe520 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.769529 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7f6f86f1-aadc-41ae-8e6b-ae58179fe520 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.769970 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7f6f86f1-aadc-41ae-8e6b-ae58179fe520 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.836546 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7f6f86f1-aadc-41ae-8e6b-ae58179fe520 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:50:38.954136 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7f6f86f1-aadc-41ae-8e6b-ae58179fe520 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 204 len: 0 microversion: 2.20 time: 0.211295 Dec 16 14:50:38.954825 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 597/1218] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Dec 16 14:50:38 2021] DELETE /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:50:38.970951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:38.972041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:38.984987 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.985588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.986521 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.986941 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:39.206388 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:39.220575 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:39.227071 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:39.228214 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-8aaefe25-fb93-47aa-8086-0ffe40baf770 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.268792 Dec 16 14:50:39.228764 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 622/1219] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:50:38 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:50:39.587565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b828637c-1ed0-4cf6-b71e-66e0b3184fa5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:39.588197 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b828637c-1ed0-4cf6-b71e-66e0b3184fa5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:39.596288 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b828637c-1ed0-4cf6-b71e-66e0b3184fa5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:39.596733 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b828637c-1ed0-4cf6-b71e-66e0b3184fa5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:39.597499 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b828637c-1ed0-4cf6-b71e-66e0b3184fa5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:39.597928 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b828637c-1ed0-4cf6-b71e-66e0b3184fa5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:39.813983 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b828637c-1ed0-4cf6-b71e-66e0b3184fa5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:39.822820 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b828637c-1ed0-4cf6-b71e-66e0b3184fa5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1513 microversion: 2.1 time: 0.246011 Dec 16 14:50:39.823582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 598/1220] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:39 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:40.252716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:40.253375 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:40.262671 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:40.263106 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:40.263893 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:40.264305 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:40.493769 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:40.509149 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:40.515426 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:40.516573 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-068c2334-0473-4bed-8871-6a93f2ea1759 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.273643 Dec 16 14:50:40.517099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 623/1221] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:50:40 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:50:40.847741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1bc4d9ac-fd17-4fec-90c6-d5605939f9dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:40.847741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1bc4d9ac-fd17-4fec-90c6-d5605939f9dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:40.855544 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bc4d9ac-fd17-4fec-90c6-d5605939f9dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:40.855996 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bc4d9ac-fd17-4fec-90c6-d5605939f9dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:40.856786 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bc4d9ac-fd17-4fec-90c6-d5605939f9dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:40.857185 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1bc4d9ac-fd17-4fec-90c6-d5605939f9dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:41.240797 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1bc4d9ac-fd17-4fec-90c6-d5605939f9dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:41.250427 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1bc4d9ac-fd17-4fec-90c6-d5605939f9dd tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1513 microversion: 2.1 time: 0.413374 Dec 16 14:50:41.251158 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 599/1222] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:40 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:41.546835 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:41.547539 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:41.556283 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:41.556711 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:41.557708 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:41.558345 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:41.712442 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-e0c6c46b-b39a-4525-9475-cefc3a7b45ff req-f3939ce1-b437-4b35-af6e-4408dbc423f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af856ef5-294f-4ede-9c79-9c71de32e0c8", "name": "network-vif-deleted", "tag": "7813cbcd-3b61-46af-8c1e-d4b2b84f58c8"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:41.731206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:41.731206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:50:41.745578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-e0c6c46b-b39a-4525-9475-cefc3a7b45ff req-f3939ce1-b437-4b35-af6e-4408dbc423f9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:41.746490 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-e0c6c46b-b39a-4525-9475-cefc3a7b45ff req-f3939ce1-b437-4b35-af6e-4408dbc423f9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:41.808508 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-e0c6c46b-b39a-4525-9475-cefc3a7b45ff req-f3939ce1-b437-4b35-af6e-4408dbc423f9 service nova] Creating event network-vif-deleted:7813cbcd-3b61-46af-8c1e-d4b2b84f58c8 for instance af856ef5-294f-4ede-9c79-9c71de32e0c8 on hv-cinder-82189 Dec 16 14:50:41.819840 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-e0c6c46b-b39a-4525-9475-cefc3a7b45ff req-f3939ce1-b437-4b35-af6e-4408dbc423f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121791 Dec 16 14:50:41.825427 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:41.826853 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 600/1223] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:41.844696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:41.852287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:41.853460 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-bf224620-84a4-4744-94b6-28bc691a62ad tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1724 microversion: 2.20 time: 0.320140 Dec 16 14:50:41.854424 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 624/1224] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:50:41 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:50:42.274887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:42.277019 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:42.284979 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:42.285426 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:42.286248 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:42.286868 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:42.367304 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:42.367767 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:42.368218 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.objects.instance [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lazy-loading 'fault' on Instance uuid af856ef5-294f-4ede-9c79-9c71de32e0c8 {{(pid=96669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:50:42.482320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:42.493165 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4ca9cd31-1e24-461a-b1cf-68c90cb76ef9 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 200 len: 1307 microversion: 2.1 time: 0.228373 Dec 16 14:50:42.493743 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 601/1225] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:42 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:42.879559 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:42.880171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:42.888286 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:42.888729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:42.889505 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:42.889921 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:42.978366 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-5cd68331-a1c4-42ec-aa40-4d1b7a02a315 req-ee3b92a3-038b-4f3a-90d3-a44386b0683e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd517a0-bd8a-4e52-93ac-304678993d24", "name": "network-vif-deleted", "tag": "89eb0392-5a52-4cad-8793-177f104836c0"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:42.987034 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:42.987034 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:50:43.003848 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5cd68331-a1c4-42ec-aa40-4d1b7a02a315 req-ee3b92a3-038b-4f3a-90d3-a44386b0683e service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.004852 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-5cd68331-a1c4-42ec-aa40-4d1b7a02a315 req-ee3b92a3-038b-4f3a-90d3-a44386b0683e service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:43.025379 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-5cd68331-a1c4-42ec-aa40-4d1b7a02a315 req-ee3b92a3-038b-4f3a-90d3-a44386b0683e service nova] Creating event network-vif-deleted:89eb0392-5a52-4cad-8793-177f104836c0 for instance 1bd517a0-bd8a-4e52-93ac-304678993d24 on hv-cinder-82189 Dec 16 14:50:43.031354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-5cd68331-a1c4-42ec-aa40-4d1b7a02a315 req-ee3b92a3-038b-4f3a-90d3-a44386b0683e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190140 Dec 16 14:50:43.032142 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 625/1226] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:43.131540 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.132038 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:43.132549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.objects.instance [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lazy-loading 'fault' on Instance uuid 1bd517a0-bd8a-4e52-93ac-304678993d24 {{(pid=96669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:50:43.216087 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:43.230950 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:43.237222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d72966786b641f48edda655d2d0ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198be39f56934fc58b1c76e532336733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:43.238638 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a58c6a56-7bac-49c3-94ef-8a1d41cb206f tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 200 len: 1371 microversion: 2.20 time: 0.369612 Dec 16 14:50:43.239240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 602/1227] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:50:42 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 1371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:50:43.520979 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-41ec2f5d-88f3-4a18-b437-9265a1aa3f15 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:43.521740 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-41ec2f5d-88f3-4a18-b437-9265a1aa3f15 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: af856ef5-294f-4ede-9c79-9c71de32e0c8] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:43.532398 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41ec2f5d-88f3-4a18-b437-9265a1aa3f15 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.533132 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41ec2f5d-88f3-4a18-b437-9265a1aa3f15 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:43.534186 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41ec2f5d-88f3-4a18-b437-9265a1aa3f15 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.534795 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-41ec2f5d-88f3-4a18-b437-9265a1aa3f15 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:43.594962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-41ec2f5d-88f3-4a18-b437-9265a1aa3f15 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] HTTP exception thrown: Instance af856ef5-294f-4ede-9c79-9c71de32e0c8 could not be found. Dec 16 14:50:43.595599 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-41ec2f5d-88f3-4a18-b437-9265a1aa3f15 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Returning 404 to user: Instance af856ef5-294f-4ede-9c79-9c71de32e0c8 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:43.596597 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-41ec2f5d-88f3-4a18-b437-9265a1aa3f15 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8" status: 404 len: 111 microversion: 2.1 time: 0.087230 Dec 16 14:50:43.597210 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 626/1228] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:43 2021] GET /compute/v2.1/servers/af856ef5-294f-4ede-9c79-9c71de32e0c8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:50:43.619486 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4b4459a0-21cf-4c1b-b8f7-79b7b7d53655 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:43.620228 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4b4459a0-21cf-4c1b-b8f7-79b7b7d53655 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:43.628787 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4b4459a0-21cf-4c1b-b8f7-79b7b7d53655 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.629337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4b4459a0-21cf-4c1b-b8f7-79b7b7d53655 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:43.630229 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4b4459a0-21cf-4c1b-b8f7-79b7b7d53655 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.630745 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4b4459a0-21cf-4c1b-b8f7-79b7b7d53655 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:43.699606 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4b4459a0-21cf-4c1b-b8f7-79b7b7d53655 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:50:43.826402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4b4459a0-21cf-4c1b-b8f7-79b7b7d53655 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "DELETE /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 204 len: 0 microversion: 2.1 time: 0.223865 Dec 16 14:50:43.827069 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 603/1229] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:50:43 2021] DELETE /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:50:43.844430 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ad5398c7-2551-487d-bf30-ba5854d1f750 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:43.845088 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ad5398c7-2551-487d-bf30-ba5854d1f750 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:43.853078 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ad5398c7-2551-487d-bf30-ba5854d1f750 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.853520 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ad5398c7-2551-487d-bf30-ba5854d1f750 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:43.854316 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ad5398c7-2551-487d-bf30-ba5854d1f750 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.854745 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ad5398c7-2551-487d-bf30-ba5854d1f750 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:44.100004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ad5398c7-2551-487d-bf30-ba5854d1f750 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:44.109232 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ad5398c7-2551-487d-bf30-ba5854d1f750 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1515 microversion: 2.1 time: 0.277750 Dec 16 14:50:44.110181 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 627/1230] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:43 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:44.263424 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-381e0695-04b2-4c33-abc9-880b8b007125 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:44.263966 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-381e0695-04b2-4c33-abc9-880b8b007125 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:44.271764 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-381e0695-04b2-4c33-abc9-880b8b007125 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:44.272191 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-381e0695-04b2-4c33-abc9-880b8b007125 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:44.272963 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-381e0695-04b2-4c33-abc9-880b8b007125 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:44.273378 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-381e0695-04b2-4c33-abc9-880b8b007125 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:44.324619 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-381e0695-04b2-4c33-abc9-880b8b007125 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] HTTP exception thrown: Instance 1bd517a0-bd8a-4e52-93ac-304678993d24 could not be found. Dec 16 14:50:44.325204 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-381e0695-04b2-4c33-abc9-880b8b007125 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Returning 404 to user: Instance 1bd517a0-bd8a-4e52-93ac-304678993d24 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:44.326125 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-381e0695-04b2-4c33-abc9-880b8b007125 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 404 len: 111 microversion: 2.20 time: 0.072997 Dec 16 14:50:44.326983 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 604/1231] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:50:44 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:50:44.342411 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a6aacb28-d297-446e-98a2-a030b0072f2b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '.version_select at 0x7f26fe6b33a0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:44.367446 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a6aacb28-d297-446e-98a2-a030b0072f2b tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-239600633" status: 204 len: 0 microversion: 2.20 time: 0.035323 Dec 16 14:50:44.368314 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 628/1232] 10.222.0.67 () {60 vars in 1258 bytes} [Thu Dec 16 14:50:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-239600633 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 16 14:50:45.132516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4e32f9d5-df4f-4184-895b-bd90ab6a2273 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:45.133870 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4e32f9d5-df4f-4184-895b-bd90ab6a2273 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:45.142143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4e32f9d5-df4f-4184-895b-bd90ab6a2273 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:45.142941 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4e32f9d5-df4f-4184-895b-bd90ab6a2273 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:45.143943 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4e32f9d5-df4f-4184-895b-bd90ab6a2273 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:45.144594 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4e32f9d5-df4f-4184-895b-bd90ab6a2273 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:45.504914 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4e32f9d5-df4f-4184-895b-bd90ab6a2273 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:45.514014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4e32f9d5-df4f-4184-895b-bd90ab6a2273 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1515 microversion: 2.1 time: 0.391052 Dec 16 14:50:45.514571 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 605/1233] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:45 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1515 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:46.537217 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-322c798d-f188-4260-aa0b-7858782fedfe tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:46.537865 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-322c798d-f188-4260-aa0b-7858782fedfe tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:46.547525 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-322c798d-f188-4260-aa0b-7858782fedfe tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:46.548154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-322c798d-f188-4260-aa0b-7858782fedfe tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:46.549212 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-322c798d-f188-4260-aa0b-7858782fedfe tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:46.549727 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-322c798d-f188-4260-aa0b-7858782fedfe tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:46.624847 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-0ee7896a-f654-409c-8b76-2fbc32823294 req-c5008576-5c42-48bb-b152-f31da8aa014e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862411e7-45f6-48d0-b01d-37109c4d9afe", "name": "network-vif-deleted", "tag": "d0b690af-263b-4ff0-8f48-ed3faf512395"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:46.635427 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:46.635427 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:50:46.659566 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-0ee7896a-f654-409c-8b76-2fbc32823294 req-c5008576-5c42-48bb-b152-f31da8aa014e service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:46.660752 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-0ee7896a-f654-409c-8b76-2fbc32823294 req-c5008576-5c42-48bb-b152-f31da8aa014e service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:46.684003 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-0ee7896a-f654-409c-8b76-2fbc32823294 req-c5008576-5c42-48bb-b152-f31da8aa014e service nova] Creating event network-vif-deleted:d0b690af-263b-4ff0-8f48-ed3faf512395 for instance 862411e7-45f6-48d0-b01d-37109c4d9afe on hv-cinder-82189 Dec 16 14:50:46.687295 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-322c798d-f188-4260-aa0b-7858782fedfe tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:46.688499 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-0ee7896a-f654-409c-8b76-2fbc32823294 req-c5008576-5c42-48bb-b152-f31da8aa014e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080178 Dec 16 14:50:46.689399 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 606/1234] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:46.698448 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-322c798d-f188-4260-aa0b-7858782fedfe tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 200 len: 1473 microversion: 2.1 time: 0.170707 Dec 16 14:50:46.699016 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 629/1235] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:46 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 1473 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:46.756020 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-feec2d05-9805-4af8-8b06-9793691fa860 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:46.756749 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-feec2d05-9805-4af8-8b06-9793691fa860 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:46.764405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-feec2d05-9805-4af8-8b06-9793691fa860 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:46.764857 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-feec2d05-9805-4af8-8b06-9793691fa860 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:46.765617 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-feec2d05-9805-4af8-8b06-9793691fa860 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:46.766072 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-feec2d05-9805-4af8-8b06-9793691fa860 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:46.818953 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-feec2d05-9805-4af8-8b06-9793691fa860 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] HTTP exception thrown: Instance 1bd517a0-bd8a-4e52-93ac-304678993d24 could not be found. Dec 16 14:50:46.819576 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-feec2d05-9805-4af8-8b06-9793691fa860 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Returning 404 to user: Instance 1bd517a0-bd8a-4e52-93ac-304678993d24 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:46.820405 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-feec2d05-9805-4af8-8b06-9793691fa860 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 404 len: 111 microversion: 2.20 time: 0.074420 Dec 16 14:50:46.821130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 607/1236] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Dec 16 14:50:46 2021] DELETE /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:50:46.836432 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e840c00c-7b8a-476b-9010-dbd61fc78a2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:46.837040 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e840c00c-7b8a-476b-9010-dbd61fc78a2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 1bd517a0-bd8a-4e52-93ac-304678993d24] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:46.845848 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e840c00c-7b8a-476b-9010-dbd61fc78a2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:46.846324 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e840c00c-7b8a-476b-9010-dbd61fc78a2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:46.847135 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e840c00c-7b8a-476b-9010-dbd61fc78a2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:46.847559 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e840c00c-7b8a-476b-9010-dbd61fc78a2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:46.900256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-e840c00c-7b8a-476b-9010-dbd61fc78a2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] HTTP exception thrown: Instance 1bd517a0-bd8a-4e52-93ac-304678993d24 could not be found. Dec 16 14:50:46.901101 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e840c00c-7b8a-476b-9010-dbd61fc78a2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Returning 404 to user: Instance 1bd517a0-bd8a-4e52-93ac-304678993d24 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:46.901704 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e840c00c-7b8a-476b-9010-dbd61fc78a2d tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24" status: 404 len: 111 microversion: 2.20 time: 0.076556 Dec 16 14:50:46.902269 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 630/1237] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:50:46 2021] GET /compute/v2.1/servers/1bd517a0-bd8a-4e52-93ac-304678993d24 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:50:47.721107 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ddad9fec-0ecb-4e6d-b6e9-7b17c9320ee7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:47.721775 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ddad9fec-0ecb-4e6d-b6e9-7b17c9320ee7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: 862411e7-45f6-48d0-b01d-37109c4d9afe] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:47.729778 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ddad9fec-0ecb-4e6d-b6e9-7b17c9320ee7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:47.730251 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ddad9fec-0ecb-4e6d-b6e9-7b17c9320ee7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:47.731010 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ddad9fec-0ecb-4e6d-b6e9-7b17c9320ee7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:47.731428 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-ddad9fec-0ecb-4e6d-b6e9-7b17c9320ee7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:47.780376 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-ddad9fec-0ecb-4e6d-b6e9-7b17c9320ee7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] HTTP exception thrown: Instance 862411e7-45f6-48d0-b01d-37109c4d9afe could not be found. Dec 16 14:50:47.780966 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ddad9fec-0ecb-4e6d-b6e9-7b17c9320ee7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Returning 404 to user: Instance 862411e7-45f6-48d0-b01d-37109c4d9afe could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:47.781826 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ddad9fec-0ecb-4e6d-b6e9-7b17c9320ee7 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe" status: 404 len: 111 microversion: 2.1 time: 0.070467 Dec 16 14:50:47.782414 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 608/1238] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:47 2021] GET /compute/v2.1/servers/862411e7-45f6-48d0-b01d-37109c4d9afe => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:50:48.177539 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1ed9fa8e-2ba2-48c8-84f4-23d5d41a91be tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:48.178125 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1ed9fa8e-2ba2-48c8-84f4-23d5d41a91be tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:48.185488 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ed9fa8e-2ba2-48c8-84f4-23d5d41a91be tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:48.185926 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ed9fa8e-2ba2-48c8-84f4-23d5d41a91be tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:48.186821 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ed9fa8e-2ba2-48c8-84f4-23d5d41a91be tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:48.187530 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-1ed9fa8e-2ba2-48c8-84f4-23d5d41a91be tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:48.240321 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-1ed9fa8e-2ba2-48c8-84f4-23d5d41a91be tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] HTTP exception thrown: Instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 could not be found. Dec 16 14:50:48.241218 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1ed9fa8e-2ba2-48c8-84f4-23d5d41a91be tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Returning 404 to user: Instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:48.242094 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1ed9fa8e-2ba2-48c8-84f4-23d5d41a91be tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 404 len: 111 microversion: 2.20 time: 0.074326 Dec 16 14:50:48.243990 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 631/1239] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Dec 16 14:50:48 2021] DELETE /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:50:48.258666 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1aee5226-b887-4ba7-a011-fabd4b8246c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:48.261158 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1aee5226-b887-4ba7-a011-fabd4b8246c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] [instance: 7e5b5c02-69ca-4290-bba0-54d6ed2eb215] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:48.269216 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1aee5226-b887-4ba7-a011-fabd4b8246c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:48.269750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1aee5226-b887-4ba7-a011-fabd4b8246c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:48.270667 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1aee5226-b887-4ba7-a011-fabd4b8246c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:48.271179 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1aee5226-b887-4ba7-a011-fabd4b8246c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:48.325019 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-1aee5226-b887-4ba7-a011-fabd4b8246c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] HTTP exception thrown: Instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 could not be found. Dec 16 14:50:48.325540 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1aee5226-b887-4ba7-a011-fabd4b8246c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] Returning 404 to user: Instance 7e5b5c02-69ca-4290-bba0-54d6ed2eb215 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:48.326392 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1aee5226-b887-4ba7-a011-fabd4b8246c4 tempest-AttachVolumeShelveTestJSON-304384041 tempest-AttachVolumeShelveTestJSON-304384041-project] 10.222.0.67 "GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215" status: 404 len: 111 microversion: 2.20 time: 0.077737 Dec 16 14:50:48.326971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 609/1240] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Dec 16 14:50:48 2021] GET /compute/v2.1/servers/7e5b5c02-69ca-4290-bba0-54d6ed2eb215 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:50:49.037083 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e828f4e8-006b-444c-b528-ffc60b2798b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:49.037678 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e828f4e8-006b-444c-b528-ffc60b2798b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:49.047399 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e828f4e8-006b-444c-b528-ffc60b2798b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:49.047840 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e828f4e8-006b-444c-b528-ffc60b2798b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:49.048608 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e828f4e8-006b-444c-b528-ffc60b2798b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:49.049781 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e828f4e8-006b-444c-b528-ffc60b2798b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:49.128431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e828f4e8-006b-444c-b528-ffc60b2798b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Going to try to terminate instance {{(pid=96670) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:50:49.264674 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e828f4e8-006b-444c-b528-ffc60b2798b5 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 204 len: 0 microversion: 2.1 time: 0.237182 Dec 16 14:50:49.266256 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 632/1241] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:50:49 2021] DELETE /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:50:49.280200 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-11c44847-61a0-451d-94be-6fe91b712042 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:49.280832 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-11c44847-61a0-451d-94be-6fe91b712042 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:49.288719 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-11c44847-61a0-451d-94be-6fe91b712042 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:49.289165 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-11c44847-61a0-451d-94be-6fe91b712042 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:49.289941 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-11c44847-61a0-451d-94be-6fe91b712042 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:49.290391 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-11c44847-61a0-451d-94be-6fe91b712042 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:49.700080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-11c44847-61a0-451d-94be-6fe91b712042 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:49.709159 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-11c44847-61a0-451d-94be-6fe91b712042 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1514 microversion: 2.1 time: 0.438305 Dec 16 14:50:49.710044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 610/1242] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:49 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1514 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:50.733573 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-236346f0-db97-416f-bb7c-055e4541c92a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:50.734357 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-236346f0-db97-416f-bb7c-055e4541c92a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:50.741851 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-236346f0-db97-416f-bb7c-055e4541c92a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:50.742352 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-236346f0-db97-416f-bb7c-055e4541c92a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:50.743125 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-236346f0-db97-416f-bb7c-055e4541c92a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:50.743556 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-236346f0-db97-416f-bb7c-055e4541c92a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:50.966500 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-236346f0-db97-416f-bb7c-055e4541c92a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:50.976749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-236346f0-db97-416f-bb7c-055e4541c92a tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1514 microversion: 2.1 time: 0.253245 Dec 16 14:50:50.978257 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 633/1243] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:50 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:52.010699 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7c22b273-7337-426e-b7a9-8d24f247721f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:52.011791 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7c22b273-7337-426e-b7a9-8d24f247721f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:52.025367 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c22b273-7337-426e-b7a9-8d24f247721f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:52.026136 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c22b273-7337-426e-b7a9-8d24f247721f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:52.027500 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c22b273-7337-426e-b7a9-8d24f247721f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:52.028242 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-7c22b273-7337-426e-b7a9-8d24f247721f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:52.679533 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-b30aa752-450f-4aeb-a216-c5e8d122acf1 req-f6da135e-97ab-4f52-a24b-d1732639742f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce2c4de-519d-4a42-924e-5e221538f9a7", "name": "network-vif-deleted", "tag": "4372c3e3-9edf-4ff8-a0ec-5eff7b96066a"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:52.703718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:52.703718 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:50:52.728227 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-b30aa752-450f-4aeb-a216-c5e8d122acf1 req-f6da135e-97ab-4f52-a24b-d1732639742f service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:52.729622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-b30aa752-450f-4aeb-a216-c5e8d122acf1 req-f6da135e-97ab-4f52-a24b-d1732639742f service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:52.772314 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-b30aa752-450f-4aeb-a216-c5e8d122acf1 req-f6da135e-97ab-4f52-a24b-d1732639742f service nova] Creating event network-vif-deleted:4372c3e3-9edf-4ff8-a0ec-5eff7b96066a for instance dce2c4de-519d-4a42-924e-5e221538f9a7 on hv-cinder-82189 Dec 16 14:50:52.782704 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-b30aa752-450f-4aeb-a216-c5e8d122acf1 req-f6da135e-97ab-4f52-a24b-d1732639742f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131907 Dec 16 14:50:52.784436 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 634/1244] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:53.034624 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7c22b273-7337-426e-b7a9-8d24f247721f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a05ec0df9334b0ca96bffdd9fdfe99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:50:53.051990 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7c22b273-7337-426e-b7a9-8d24f247721f tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 200 len: 1514 microversion: 2.1 time: 1.059283 Dec 16 14:50:53.053386 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 611/1245] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:51 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 1514 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:54.084546 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fb54a109-4248-480f-94f4-88de22e2b511 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:54.085292 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fb54a109-4248-480f-94f4-88de22e2b511 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] [instance: dce2c4de-519d-4a42-924e-5e221538f9a7] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:50:54.094281 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb54a109-4248-480f-94f4-88de22e2b511 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:54.094729 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb54a109-4248-480f-94f4-88de22e2b511 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:54.095534 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb54a109-4248-480f-94f4-88de22e2b511 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:54.095999 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fb54a109-4248-480f-94f4-88de22e2b511 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:54.151776 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-fb54a109-4248-480f-94f4-88de22e2b511 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] HTTP exception thrown: Instance dce2c4de-519d-4a42-924e-5e221538f9a7 could not be found. Dec 16 14:50:54.152441 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fb54a109-4248-480f-94f4-88de22e2b511 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] Returning 404 to user: Instance dce2c4de-519d-4a42-924e-5e221538f9a7 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:54.153797 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fb54a109-4248-480f-94f4-88de22e2b511 tempest-AttachVolumeNegativeTest-1445539459 tempest-AttachVolumeNegativeTest-1445539459-project] 10.222.0.67 "GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7" status: 404 len: 111 microversion: 2.1 time: 0.079779 Dec 16 14:50:54.158026 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 635/1246] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:54 2021] GET /compute/v2.1/servers/dce2c4de-519d-4a42-924e-5e221538f9a7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:50:58.065840 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d901c2c3-1114-479f-9e4e-b16df369ff6b tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Action: 'create', calling method: .version_select at 0x7f26fe614670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1410156934", "metadata": {"Type": "work"}}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:58.067353 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d901c2c3-1114-479f-9e4e-b16df369ff6b tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:58.068146 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d901c2c3-1114-479f-9e4e-b16df369ff6b tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.157634 Dec 16 14:50:58.068668 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 612/1247] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Dec 16 14:50:57 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:50:58.086840 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5082f246-2943-4450-a6ca-81d0ece7f1f0 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Action: 'create', calling method: .version_select at 0x7f26fe645280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-128985973", "metadata": {"Type": "work"}}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:58.088302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5082f246-2943-4450-a6ca-81d0ece7f1f0 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:58.089092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5082f246-2943-4450-a6ca-81d0ece7f1f0 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014535 Dec 16 14:50:58.089612 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 636/1248] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Dec 16 14:50:58 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:50:58.105717 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ce62f85d-326c-46d9-b5a9-a18626907bd9 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Action: 'create', calling method: .version_select at 0x7f26fe5a3ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-627736136", "metadata": {"Type": "work"}}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:58.107821 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ce62f85d-326c-46d9-b5a9-a18626907bd9 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:58.108837 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ce62f85d-326c-46d9-b5a9-a18626907bd9 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012635 Dec 16 14:50:58.109284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 613/1249] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Dec 16 14:50:58 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:50:58.124696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-68b831b2-3063-43df-a986-33611684ea4b tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Calling method '.version_select at 0x7f26fe6623a0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:58.197164 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-68b831b2-3063-43df-a986-33611684ea4b tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] HTTP exception thrown: Volume tempest-invalid-167138692 could not be found. Dec 16 14:50:58.197766 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-68b831b2-3063-43df-a986-33611684ea4b tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Returning 404 to user: Volume tempest-invalid-167138692 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:58.198600 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-68b831b2-3063-43df-a986-33611684ea4b tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-167138692" status: 404 len: 98 microversion: 2.1 time: 0.083429 Dec 16 14:50:58.199135 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 637/1250] 10.222.0.67 () {58 vars in 1214 bytes} [Thu Dec 16 14:50:58 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-167138692 => generated 98 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 16 14:50:58.215971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5c5a3694-98c4-4848-abec-079b69a7979b tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008955 Dec 16 14:50:58.216473 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 614/1251] 10.222.0.67 () {58 vars in 1139 bytes} [Thu Dec 16 14:50:58 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 14:50:58.230481 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ff9e69dd-758d-4334-add2-aae0bf50812b tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008828 Dec 16 14:50:58.231088 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 638/1252] 10.222.0.67 () {58 vars in 1136 bytes} [Thu Dec 16 14:50:58 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 14:50:58.246930 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-40781a70-0892-42d9-9c3b-6eda0784b15c tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Calling method '.version_select at 0x7f26fe541dc0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:58.319380 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-40781a70-0892-42d9-9c3b-6eda0784b15c tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] HTTP exception thrown: Volume 34cc999b-88a5-474e-bf00-877e19c42a8c could not be found. Dec 16 14:50:58.320146 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-40781a70-0892-42d9-9c3b-6eda0784b15c tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Returning 404 to user: Volume 34cc999b-88a5-474e-bf00-877e19c42a8c could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:58.321115 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-40781a70-0892-42d9-9c3b-6eda0784b15c tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/34cc999b-88a5-474e-bf00-877e19c42a8c" status: 404 len: 109 microversion: 2.1 time: 0.084728 Dec 16 14:50:58.321717 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 615/1253] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Dec 16 14:50:58 2021] DELETE /compute/v2.1/os-volumes/34cc999b-88a5-474e-bf00-877e19c42a8c => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:50:58.337383 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fa548ebb-f96d-42ff-9dfa-e12c1cd81567 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Calling method '.version_select at 0x7f26fe6b33a0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:58.406363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-fa548ebb-f96d-42ff-9dfa-e12c1cd81567 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] HTTP exception thrown: Volume 582dc970-7db4-4830-ab57-0a72711383fc could not be found. Dec 16 14:50:58.407704 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fa548ebb-f96d-42ff-9dfa-e12c1cd81567 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] Returning 404 to user: Volume 582dc970-7db4-4830-ab57-0a72711383fc could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:50:58.408617 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fa548ebb-f96d-42ff-9dfa-e12c1cd81567 tempest-VolumesNegativeTest-1448298014 tempest-VolumesNegativeTest-1448298014-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/582dc970-7db4-4830-ab57-0a72711383fc" status: 404 len: 109 microversion: 2.1 time: 0.081602 Dec 16 14:50:58.409200 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 639/1254] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:50:58 2021] GET /compute/v2.1/os-volumes/582dc970-7db4-4830-ab57-0a72711383fc => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:50:58.687532 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-34179869-0fe5-4573-9cfe-d47f9361860c tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe4ce550>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:58.790032 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-34179869-0fe5-4573-9cfe-d47f9361860c tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/782d9e4e-90ea-4497-818b-be7c3ea6f5dd" status: 200 len: 350 microversion: 2.1 time: 0.111540 Dec 16 14:50:58.790569 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 616/1255] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:50:58 2021] GET /compute/v2.1/os-volumes/782d9e4e-90ea-4497-818b-be7c3ea6f5dd => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:00.475812 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-80eb9c5b-2ca4-48f7-bbb4-979338ed4a8e tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe3e79d0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:00.586191 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-80eb9c5b-2ca4-48f7-bbb4-979338ed4a8e tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c5926944-5f9e-4fea-a28a-5a96d226eac6" status: 200 len: 350 microversion: 2.1 time: 0.122726 Dec 16 14:51:00.586739 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 640/1256] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:51:00 2021] GET /compute/v2.1/os-volumes/c5926944-5f9e-4fea-a28a-5a96d226eac6 => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:02.219667 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-54f2eb0c-57ea-4bb3-89c2-268e4903ec50 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe4cef70>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:02.325041 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-54f2eb0c-57ea-4bb3-89c2-268e4903ec50 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/7e1fe65e-bd07-4fcf-ac3d-ff876ee6418f" status: 200 len: 350 microversion: 2.1 time: 0.115327 Dec 16 14:51:02.326073 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 617/1257] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Dec 16 14:51:02 2021] GET /compute/v2.1/os-volumes/7e1fe65e-bd07-4fcf-ac3d-ff876ee6418f => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:02.344177 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-327a7fd2-e34c-40bb-b3e9-fbcf5796a239 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe6b38b0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:02.454585 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-327a7fd2-e34c-40bb-b3e9-fbcf5796a239 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.120647 Dec 16 14:51:02.455663 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 641/1258] 10.222.0.67 () {58 vars in 1133 bytes} [Thu Dec 16 14:51:02 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:51:02.481983 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d137b331-4caa-48f6-9150-6166fa789b1d tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe667c10>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:02.590509 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d137b331-4caa-48f6-9150-6166fa789b1d tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.120207 Dec 16 14:51:02.591077 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 618/1259] 10.222.0.67 () {58 vars in 1148 bytes} [Thu Dec 16 14:51:02 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:51:02.608768 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9d8fb928-6284-46ee-82dc-ac2d610306e5 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe662d30>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:02.730530 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9d8fb928-6284-46ee-82dc-ac2d610306e5 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.130802 Dec 16 14:51:02.731517 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 642/1260] 10.222.0.67 () {58 vars in 1133 bytes} [Thu Dec 16 14:51:02 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:02.748708 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cff71440-0fd9-4985-803a-06b63015b28d tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe6144c0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:02.801755 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d120072-e536-428c-9013-c2f8ecacc31c] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 14:51:02.847954 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cff71440-0fd9-4985-803a-06b63015b28d tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.108671 Dec 16 14:51:02.848572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 619/1261] 10.222.0.67 () {58 vars in 1166 bytes} [Thu Dec 16 14:51:02 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:02.867930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fd3efdb4-5968-49fe-b52e-db377e05a454 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe169790>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:02.962273 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fd3efdb4-5968-49fe-b52e-db377e05a454 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.105342 Dec 16 14:51:02.962980 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 643/1262] 10.222.0.67 () {58 vars in 1169 bytes} [Thu Dec 16 14:51:02 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:51:02.981303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4113c261-9c05-43da-8700-fcc8d4be6233 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe5c7550>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:03.070219 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4113c261-9c05-43da-8700-fcc8d4be6233 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.098247 Dec 16 14:51:03.070791 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 620/1263] 10.222.0.67 () {58 vars in 1154 bytes} [Thu Dec 16 14:51:02 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:03.091637 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fdc7647d-c3c1-4f27-b71c-b4021cc9312a tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe169ee0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:03.222903 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fdc7647d-c3c1-4f27-b71c-b4021cc9312a tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.143029 Dec 16 14:51:03.224005 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 644/1264] 10.222.0.67 () {58 vars in 1187 bytes} [Thu Dec 16 14:51:03 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:03.242964 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c2e1ecd5-e802-466f-80b4-90ae11583d50 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] Calling method '.version_select at 0x7f26fe614dc0>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:03.340666 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c2e1ecd5-e802-466f-80b4-90ae11583d50 tempest-VolumesTestJSON-2076459698 tempest-VolumesTestJSON-2076459698-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.108077 Dec 16 14:51:03.341423 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 621/1265] 10.222.0.67 () {58 vars in 1154 bytes} [Thu Dec 16 14:51:03 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:19.502179 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1182618165", "imageRef": "f1db0ca3-a217-4d4a-9605-c0516ab1e2ad", "flavorRef": "452"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:19.575748 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.network.neutron [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] validate_networks() for None {{(pid=96670) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:51:19.839745 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Flavor limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:51:19.840157 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Image limits 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:51:19.840616 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Flavor pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:51:19.841045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Image pref 0:0:0 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:51:19.841698 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.virt.hardware [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:51:19.850647 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:19.851198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:19.851986 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:19.852402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:19.870140 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Getting quotas for project 5497f03113bd435d9b101817e624fa38. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:51:19.874146 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Getting quotas for user 16582188a9d148a58da4364890bace4c and project 5497f03113bd435d9b101817e624fa38. Resources: {'ram', 'cores', 'instances'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:51:19.885688 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Going to run 1 instances... {{(pid=96670) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:51:19.888109 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1db0ca3-a217-4d4a-9605-c0516ab1e2ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:51:19.932823 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-69a7329e-31a6-4691-b383-0d0bbf82e627 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.440428 Dec 16 14:51:19.933390 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 645/1266] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:51:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:51:19.949014 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a52b3c4d-a52c-41ef-aac7-78ac4a16c6c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:19.950360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a52b3c4d-a52c-41ef-aac7-78ac4a16c6c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:20.003831 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d120072-e536-428c-9013-c2f8ecacc31c] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40334. Dec 16 14:51:20.053113 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-a52b3c4d-a52c-41ef-aac7-78ac4a16c6c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:20.062245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a52b3c4d-a52c-41ef-aac7-78ac4a16c6c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1215 microversion: 2.1 time: 0.122792 Dec 16 14:51:20.063639 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 622/1267] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:19 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:21.085597 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b384d477-d883-4441-9fa0-d71c3368e3d4 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:21.086221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b384d477-d883-4441-9fa0-d71c3368e3d4 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:21.096519 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b384d477-d883-4441-9fa0-d71c3368e3d4 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:21.097598 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b384d477-d883-4441-9fa0-d71c3368e3d4 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:21.099222 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b384d477-d883-4441-9fa0-d71c3368e3d4 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:21.100369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b384d477-d883-4441-9fa0-d71c3368e3d4 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:21.268401 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b384d477-d883-4441-9fa0-d71c3368e3d4 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:21.277923 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b384d477-d883-4441-9fa0-d71c3368e3d4 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1267 microversion: 2.1 time: 0.201842 Dec 16 14:51:21.278519 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 646/1268] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:21 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:22.300988 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-00e9161c-697d-4d27-adef-402492aa0357 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:22.301714 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-00e9161c-697d-4d27-adef-402492aa0357 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:22.310617 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-00e9161c-697d-4d27-adef-402492aa0357 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:22.311310 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-00e9161c-697d-4d27-adef-402492aa0357 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:22.311850 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-00e9161c-697d-4d27-adef-402492aa0357 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:22.312249 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-00e9161c-697d-4d27-adef-402492aa0357 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:22.452685 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-00e9161c-697d-4d27-adef-402492aa0357 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:22.464589 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-00e9161c-697d-4d27-adef-402492aa0357 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1273 microversion: 2.1 time: 0.172945 Dec 16 14:51:22.466080 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 623/1269] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:22 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:23.488478 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-24cf1e82-ad23-443b-b563-e1a8840b99dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:23.489114 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-24cf1e82-ad23-443b-b563-e1a8840b99dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:23.497028 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-24cf1e82-ad23-443b-b563-e1a8840b99dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:23.497509 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-24cf1e82-ad23-443b-b563-e1a8840b99dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:23.498437 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-24cf1e82-ad23-443b-b563-e1a8840b99dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:23.498871 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-24cf1e82-ad23-443b-b563-e1a8840b99dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:23.685474 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-6e839667-fa28-4eea-9dbe-46b7d4a61617 req-3215e71f-8e80-4a53-8769-3cee178b2062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1e27fc-8204-401b-8cea-50e8aff5fe0e", "tag": "d01e269d-5b4b-4e62-8e9f-c79159aa2d6d"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:23.692982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:51:23.692982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:51:23.706556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-6e839667-fa28-4eea-9dbe-46b7d4a61617 req-3215e71f-8e80-4a53-8769-3cee178b2062 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:23.707177 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-6e839667-fa28-4eea-9dbe-46b7d4a61617 req-3215e71f-8e80-4a53-8769-3cee178b2062 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:23.744041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-24cf1e82-ad23-443b-b563-e1a8840b99dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:23.744719 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-6e839667-fa28-4eea-9dbe-46b7d4a61617 req-3215e71f-8e80-4a53-8769-3cee178b2062 service nova] Creating event network-changed:d01e269d-5b4b-4e62-8e9f-c79159aa2d6d for instance 6d1e27fc-8204-401b-8cea-50e8aff5fe0e on hv-cinder-82189 Dec 16 14:51:23.752467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-6e839667-fa28-4eea-9dbe-46b7d4a61617 req-3215e71f-8e80-4a53-8769-3cee178b2062 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108328 Dec 16 14:51:23.754077 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 624/1270] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:23.754996 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-24cf1e82-ad23-443b-b563-e1a8840b99dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1315 microversion: 2.1 time: 0.275641 Dec 16 14:51:23.755876 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 647/1271] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:23 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:24.780168 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2dcb3466-fe3d-408d-9800-ae5b2b47a7dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:24.781039 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2dcb3466-fe3d-408d-9800-ae5b2b47a7dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:24.789302 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2dcb3466-fe3d-408d-9800-ae5b2b47a7dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:24.789742 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2dcb3466-fe3d-408d-9800-ae5b2b47a7dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:24.790554 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2dcb3466-fe3d-408d-9800-ae5b2b47a7dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:24.791034 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2dcb3466-fe3d-408d-9800-ae5b2b47a7dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:25.255571 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-2dcb3466-fe3d-408d-9800-ae5b2b47a7dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:25.265155 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2dcb3466-fe3d-408d-9800-ae5b2b47a7dc tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1315 microversion: 2.1 time: 0.497500 Dec 16 14:51:25.265715 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 625/1272] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:24 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:26.288495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c8f5f7ce-0348-46fc-b2c9-d67758ddc58c tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:26.289662 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c8f5f7ce-0348-46fc-b2c9-d67758ddc58c tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:26.297521 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7ce-0348-46fc-b2c9-d67758ddc58c tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:26.297971 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7ce-0348-46fc-b2c9-d67758ddc58c tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:26.298779 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7ce-0348-46fc-b2c9-d67758ddc58c tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:26.299193 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7ce-0348-46fc-b2c9-d67758ddc58c tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:26.533343 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-c8f5f7ce-0348-46fc-b2c9-d67758ddc58c tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:26.542417 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c8f5f7ce-0348-46fc-b2c9-d67758ddc58c tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1315 microversion: 2.1 time: 0.263483 Dec 16 14:51:26.542981 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 648/1273] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:26 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:27.565980 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f73e1ce1-b20a-4f1a-b97c-88f8dc969227 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:27.566582 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f73e1ce1-b20a-4f1a-b97c-88f8dc969227 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:27.574589 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f73e1ce1-b20a-4f1a-b97c-88f8dc969227 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:27.575333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f73e1ce1-b20a-4f1a-b97c-88f8dc969227 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:27.576138 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f73e1ce1-b20a-4f1a-b97c-88f8dc969227 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:27.576560 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f73e1ce1-b20a-4f1a-b97c-88f8dc969227 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:27.804941 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f73e1ce1-b20a-4f1a-b97c-88f8dc969227 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:27.813474 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f73e1ce1-b20a-4f1a-b97c-88f8dc969227 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1315 microversion: 2.1 time: 0.257103 Dec 16 14:51:27.814259 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 626/1274] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:27 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:28.836236 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-0f6f190f-34d3-4f2b-aa87-7ece971f005f tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:28.836824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-0f6f190f-34d3-4f2b-aa87-7ece971f005f tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:28.845260 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f6f190f-34d3-4f2b-aa87-7ece971f005f tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:28.845824 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f6f190f-34d3-4f2b-aa87-7ece971f005f tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:28.846793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f6f190f-34d3-4f2b-aa87-7ece971f005f tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:28.847337 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-0f6f190f-34d3-4f2b-aa87-7ece971f005f tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:29.066989 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-0f6f190f-34d3-4f2b-aa87-7ece971f005f tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:29.075855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-0f6f190f-34d3-4f2b-aa87-7ece971f005f tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1315 microversion: 2.1 time: 0.249051 Dec 16 14:51:29.076409 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 649/1275] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:28 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:29.900132 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-2e9d61f9-453a-41c1-b20f-fcd5e212c082 req-d95db330-afd7-4a14-a476-341e3dadd023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1e27fc-8204-401b-8cea-50e8aff5fe0e", "name": "network-vif-plugged", "status": "completed", "tag": "d01e269d-5b4b-4e62-8e9f-c79159aa2d6d"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:29.913132 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:51:29.913132 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:51:29.921769 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-2e9d61f9-453a-41c1-b20f-fcd5e212c082 req-d95db330-afd7-4a14-a476-341e3dadd023 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:29.922255 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-2e9d61f9-453a-41c1-b20f-fcd5e212c082 req-d95db330-afd7-4a14-a476-341e3dadd023 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:29.939140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-2e9d61f9-453a-41c1-b20f-fcd5e212c082 req-d95db330-afd7-4a14-a476-341e3dadd023 service nova] Creating event network-vif-plugged:d01e269d-5b4b-4e62-8e9f-c79159aa2d6d for instance 6d1e27fc-8204-401b-8cea-50e8aff5fe0e on hv-cinder-82189 Dec 16 14:51:29.944349 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-2e9d61f9-453a-41c1-b20f-fcd5e212c082 req-d95db330-afd7-4a14-a476-341e3dadd023 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055367 Dec 16 14:51:29.945301 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 627/1276] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:51:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:30.099058 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e4d634c8-5f94-4f73-9ecf-fe87128a5056 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:30.100004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e4d634c8-5f94-4f73-9ecf-fe87128a5056 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:30.108789 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4d634c8-5f94-4f73-9ecf-fe87128a5056 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:30.109421 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4d634c8-5f94-4f73-9ecf-fe87128a5056 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:30.110287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4d634c8-5f94-4f73-9ecf-fe87128a5056 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:30.110721 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e4d634c8-5f94-4f73-9ecf-fe87128a5056 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:30.333085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e4d634c8-5f94-4f73-9ecf-fe87128a5056 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:30.342092 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e4d634c8-5f94-4f73-9ecf-fe87128a5056 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1315 microversion: 2.1 time: 0.252640 Dec 16 14:51:30.342689 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 650/1277] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:30 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:31.369726 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f23662ba-1e15-4cc8-8b12-4e24235774f5 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:31.370498 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f23662ba-1e15-4cc8-8b12-4e24235774f5 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:31.378904 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f23662ba-1e15-4cc8-8b12-4e24235774f5 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:31.379358 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f23662ba-1e15-4cc8-8b12-4e24235774f5 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:31.380253 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f23662ba-1e15-4cc8-8b12-4e24235774f5 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:31.381240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f23662ba-1e15-4cc8-8b12-4e24235774f5 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:31.612332 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f23662ba-1e15-4cc8-8b12-4e24235774f5 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:31.624602 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f23662ba-1e15-4cc8-8b12-4e24235774f5 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1315 microversion: 2.1 time: 0.268041 Dec 16 14:51:31.625108 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 628/1278] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:31 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:32.647958 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2ad58f03-25f2-4a87-86b2-8727e0b5d4fa tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:32.648696 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2ad58f03-25f2-4a87-86b2-8727e0b5d4fa tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:32.656550 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2ad58f03-25f2-4a87-86b2-8727e0b5d4fa tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:32.657006 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2ad58f03-25f2-4a87-86b2-8727e0b5d4fa tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:32.657771 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2ad58f03-25f2-4a87-86b2-8727e0b5d4fa tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:32.658243 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2ad58f03-25f2-4a87-86b2-8727e0b5d4fa tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:32.876057 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2ad58f03-25f2-4a87-86b2-8727e0b5d4fa tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:32.889236 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2ad58f03-25f2-4a87-86b2-8727e0b5d4fa tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1465 microversion: 2.1 time: 0.250666 Dec 16 14:51:32.890004 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 651/1279] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:32 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1465 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:32.967745 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-a8c2b3ef-6ba4-4ff8-beea-5753be995a52 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:32.968357 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a8c2b3ef-6ba4-4ff8-beea-5753be995a52 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:32.981318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a8c2b3ef-6ba4-4ff8-beea-5753be995a52 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:32.981750 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a8c2b3ef-6ba4-4ff8-beea-5753be995a52 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:32.982556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a8c2b3ef-6ba4-4ff8-beea-5753be995a52 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:32.982973 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-a8c2b3ef-6ba4-4ff8-beea-5753be995a52 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:33.052736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-a8c2b3ef-6ba4-4ff8-beea-5753be995a52 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:51:33.174773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-a8c2b3ef-6ba4-4ff8-beea-5753be995a52 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 204 len: 0 microversion: 2.1 time: 0.216278 Dec 16 14:51:33.178025 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 629/1280] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:51:32 2021] DELETE /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:51:33.190189 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7280f411-8f72-419e-93b8-2acd4253025d tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:33.190793 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7280f411-8f72-419e-93b8-2acd4253025d tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:33.199154 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7280f411-8f72-419e-93b8-2acd4253025d tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:33.199622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7280f411-8f72-419e-93b8-2acd4253025d tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:33.200405 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7280f411-8f72-419e-93b8-2acd4253025d tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:33.200829 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-7280f411-8f72-419e-93b8-2acd4253025d tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:33.450195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7280f411-8f72-419e-93b8-2acd4253025d tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:33.462151 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7280f411-8f72-419e-93b8-2acd4253025d tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1471 microversion: 2.1 time: 0.281522 Dec 16 14:51:33.462763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 652/1281] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:33 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:34.490990 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d7fd400f-3ddc-4e1e-8c0e-23d7785a5607 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:34.492040 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d7fd400f-3ddc-4e1e-8c0e-23d7785a5607 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:34.500035 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7fd400f-3ddc-4e1e-8c0e-23d7785a5607 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:34.500457 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7fd400f-3ddc-4e1e-8c0e-23d7785a5607 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:34.501236 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7fd400f-3ddc-4e1e-8c0e-23d7785a5607 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:34.501654 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d7fd400f-3ddc-4e1e-8c0e-23d7785a5607 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:34.726893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d7fd400f-3ddc-4e1e-8c0e-23d7785a5607 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:34.736429 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d7fd400f-3ddc-4e1e-8c0e-23d7785a5607 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1471 microversion: 2.1 time: 0.256160 Dec 16 14:51:34.736999 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 630/1282] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:34 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1471 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:35.763511 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ed48dc46-7234-408e-beb0-473dd54fe1c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:35.764297 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ed48dc46-7234-408e-beb0-473dd54fe1c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:35.774354 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed48dc46-7234-408e-beb0-473dd54fe1c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:35.775019 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed48dc46-7234-408e-beb0-473dd54fe1c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:35.776355 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed48dc46-7234-408e-beb0-473dd54fe1c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:35.776854 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-ed48dc46-7234-408e-beb0-473dd54fe1c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:35.940243 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-cb860088-ee85-46c6-ae4a-52f89dfcb3de req-3531d6d2-5a59-4ce0-ac80-a0d24615c74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1e27fc-8204-401b-8cea-50e8aff5fe0e", "name": "network-vif-deleted", "tag": "d01e269d-5b4b-4e62-8e9f-c79159aa2d6d"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:35.955721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:51:35.955721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:51:35.966455 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-cb860088-ee85-46c6-ae4a-52f89dfcb3de req-3531d6d2-5a59-4ce0-ac80-a0d24615c74c service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:35.967196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-cb860088-ee85-46c6-ae4a-52f89dfcb3de req-3531d6d2-5a59-4ce0-ac80-a0d24615c74c service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:35.994301 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-cb860088-ee85-46c6-ae4a-52f89dfcb3de req-3531d6d2-5a59-4ce0-ac80-a0d24615c74c service nova] Creating event network-vif-deleted:d01e269d-5b4b-4e62-8e9f-c79159aa2d6d for instance 6d1e27fc-8204-401b-8cea-50e8aff5fe0e on hv-cinder-82189 Dec 16 14:51:35.999613 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-cb860088-ee85-46c6-ae4a-52f89dfcb3de req-3531d6d2-5a59-4ce0-ac80-a0d24615c74c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069829 Dec 16 14:51:36.000322 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 631/1283] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:51:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:36.029854 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ed48dc46-7234-408e-beb0-473dd54fe1c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16582188a9d148a58da4364890bace4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5497f03113bd435d9b101817e624fa38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:51:36.040798 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ed48dc46-7234-408e-beb0-473dd54fe1c1 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 200 len: 1429 microversion: 2.1 time: 0.288487 Dec 16 14:51:36.041837 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 653/1284] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:35 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 1429 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:37.065533 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-82678699-89f0-44a5-8aab-9f54d54684b6 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:37.066344 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-82678699-89f0-44a5-8aab-9f54d54684b6 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] [instance: 6d1e27fc-8204-401b-8cea-50e8aff5fe0e] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:51:37.074548 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-82678699-89f0-44a5-8aab-9f54d54684b6 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:37.074995 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-82678699-89f0-44a5-8aab-9f54d54684b6 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:37.075766 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-82678699-89f0-44a5-8aab-9f54d54684b6 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:37.076196 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-82678699-89f0-44a5-8aab-9f54d54684b6 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:37.127969 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-82678699-89f0-44a5-8aab-9f54d54684b6 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] HTTP exception thrown: Instance 6d1e27fc-8204-401b-8cea-50e8aff5fe0e could not be found. Dec 16 14:51:37.129103 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-82678699-89f0-44a5-8aab-9f54d54684b6 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] Returning 404 to user: Instance 6d1e27fc-8204-401b-8cea-50e8aff5fe0e could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:51:37.129948 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-82678699-89f0-44a5-8aab-9f54d54684b6 tempest-VolumesNegativeTest-79501235 tempest-VolumesNegativeTest-79501235-project] 10.222.0.67 "GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e" status: 404 len: 111 microversion: 2.1 time: 0.074811 Dec 16 14:51:37.130604 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 632/1285] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:37 2021] GET /compute/v2.1/servers/6d1e27fc-8204-401b-8cea-50e8aff5fe0e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:52:14.713408 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-190195c6-4814-4dae-843f-fc554d658d4e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Action: 'create', calling method: .version_select at 0x7f26fe5fec10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1066298988"}} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:52:14.747503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-190195c6-4814-4dae-843f-fc554d658d4e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:52:14.752146 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-190195c6-4814-4dae-843f-fc554d658d4e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for user 7499170b07074cb2aa9319c0c7a119ee and project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:52:14.928021 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-190195c6-4814-4dae-843f-fc554d658d4e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:52:14.931850 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.quota [None req-190195c6-4814-4dae-843f-fc554d658d4e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for user 7499170b07074cb2aa9319c0c7a119ee and project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'key_pairs'} {{(pid=96670) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:52:14.945879 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-190195c6-4814-4dae-843f-fc554d658d4e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.476918 Dec 16 14:52:14.946527 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 654/1286] 10.222.0.67 () {60 vars in 1157 bytes} [Thu Dec 16 14:52:14 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:38.978716 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-290393881", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1066298988", "security_groups": [{"name": "tempest-secgroup-smoke-116736629"}], "block_device_mapping_v2": [{"uuid": "303757ef-d860-43f5-862d-ca8329d46ec3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4601ad77-56d7-4b99-978d-819541f9e442"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:52:39.178120 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] validate_networks() for [('4601ad77-56d7-4b99-978d-819541f9e442', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:52:39.973741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:52:39.974203 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:52:39.974654 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:52:39.975070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:52:39.975447 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:52:39.984854 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:39.985514 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:39.986094 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:39.986510 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:40.003622 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:52:40.007741 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for user 7499170b07074cb2aa9319c0c7a119ee and project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:52:40.119774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:52:40.122387 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='303757ef-d860-43f5-862d-ca8329d46ec3',volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:52:40.321021 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [fec6e6a1-c933-46c7-bc8b-cb73e2fce007] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:52:41.340226 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [fec6e6a1-c933-46c7-bc8b-cb73e2fce007] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41018. Dec 16 14:52:41.344481 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2f6ccf96-d0ae-4f16-9755-08e8fe726d26 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.375458 Dec 16 14:52:41.345097 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 633/1287] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:52:38 2021] POST /compute/v2.1/servers => generated 405 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:52:41.361242 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-018f59f5-2523-43b8-8f02-0d2538145a80 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:41.361855 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-018f59f5-2523-43b8-8f02-0d2538145a80 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:41.461593 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-018f59f5-2523-43b8-8f02-0d2538145a80 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:41.469663 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-018f59f5-2523-43b8-8f02-0d2538145a80 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1094 microversion: 2.1 time: 0.118234 Dec 16 14:52:41.470234 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 655/1288] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:41 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:42.494224 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c75ccf47-bcd7-4bad-b991-e5494f1dc61e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:42.494859 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c75ccf47-bcd7-4bad-b991-e5494f1dc61e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:42.580434 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c75ccf47-bcd7-4bad-b991-e5494f1dc61e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:42.589198 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c75ccf47-bcd7-4bad-b991-e5494f1dc61e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1094 microversion: 2.1 time: 0.105849 Dec 16 14:52:42.589770 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 634/1289] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:42 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:43.612656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7d14c00d-fb10-45ec-819e-7d9d339b6088 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:43.613267 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7d14c00d-fb10-45ec-819e-7d9d339b6088 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:43.703897 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7d14c00d-fb10-45ec-819e-7d9d339b6088 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:43.711364 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7d14c00d-fb10-45ec-819e-7d9d339b6088 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1094 microversion: 2.1 time: 0.108438 Dec 16 14:52:43.712222 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 656/1290] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:43 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:44.734477 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4ad4d8d5-fe01-4653-b550-2ee2e265d7b8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:44.735556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4ad4d8d5-fe01-4653-b550-2ee2e265d7b8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:44.744377 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ad4d8d5-fe01-4653-b550-2ee2e265d7b8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:44.744829 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ad4d8d5-fe01-4653-b550-2ee2e265d7b8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:44.745613 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ad4d8d5-fe01-4653-b550-2ee2e265d7b8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:44.746068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-4ad4d8d5-fe01-4653-b550-2ee2e265d7b8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:44.905549 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4ad4d8d5-fe01-4653-b550-2ee2e265d7b8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:44.914434 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4ad4d8d5-fe01-4653-b550-2ee2e265d7b8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1210 microversion: 2.1 time: 0.189405 Dec 16 14:52:44.915697 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 635/1291] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:44 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1210 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:45.938811 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b696a44e-07a2-48a2-9b7d-3108c31a1fd4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:45.940294 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b696a44e-07a2-48a2-9b7d-3108c31a1fd4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:45.949053 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b696a44e-07a2-48a2-9b7d-3108c31a1fd4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:45.949795 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b696a44e-07a2-48a2-9b7d-3108c31a1fd4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:45.950668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b696a44e-07a2-48a2-9b7d-3108c31a1fd4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:45.951099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b696a44e-07a2-48a2-9b7d-3108c31a1fd4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:46.255150 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b696a44e-07a2-48a2-9b7d-3108c31a1fd4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:46.265578 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b696a44e-07a2-48a2-9b7d-3108c31a1fd4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.337194 Dec 16 14:52:46.266198 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 657/1292] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:45 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:46.714898 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-050c5753-8864-4857-9db4-d61fdc217d73 req-bdcddcb1-b229-430b-a252-c1416af63113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42478ff5-0e4e-4b8a-812b-1c86dcb24306", "tag": "080fe726-38f3-4048-85d9-c1b48600093c"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:52:46.723516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:52:46.723516 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:52:46.733579 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-050c5753-8864-4857-9db4-d61fdc217d73 req-bdcddcb1-b229-430b-a252-c1416af63113 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:46.734059 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-050c5753-8864-4857-9db4-d61fdc217d73 req-bdcddcb1-b229-430b-a252-c1416af63113 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:46.751211 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-050c5753-8864-4857-9db4-d61fdc217d73 req-bdcddcb1-b229-430b-a252-c1416af63113 service nova] Creating event network-changed:080fe726-38f3-4048-85d9-c1b48600093c for instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 on hv-cinder-82189 Dec 16 14:52:46.756261 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-050c5753-8864-4857-9db4-d61fdc217d73 req-bdcddcb1-b229-430b-a252-c1416af63113 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064815 Dec 16 14:52:46.757484 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 636/1293] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:52:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:52:47.290431 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-26132491-5c0c-4c4c-90d9-de012b84feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:47.291213 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-26132491-5c0c-4c4c-90d9-de012b84feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:47.298857 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-26132491-5c0c-4c4c-90d9-de012b84feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:47.299308 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-26132491-5c0c-4c4c-90d9-de012b84feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:47.300093 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-26132491-5c0c-4c4c-90d9-de012b84feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:47.300520 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-26132491-5c0c-4c4c-90d9-de012b84feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:47.525397 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-26132491-5c0c-4c4c-90d9-de012b84feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:47.534921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-26132491-5c0c-4c4c-90d9-de012b84feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.255924 Dec 16 14:52:47.535518 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 658/1294] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:47 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:48.560000 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-461918b3-b953-4cf7-a694-eae574288b61 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:48.560696 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-461918b3-b953-4cf7-a694-eae574288b61 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:48.568811 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-461918b3-b953-4cf7-a694-eae574288b61 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:48.569262 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-461918b3-b953-4cf7-a694-eae574288b61 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:48.570137 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-461918b3-b953-4cf7-a694-eae574288b61 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:48.570565 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-461918b3-b953-4cf7-a694-eae574288b61 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:48.807126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-461918b3-b953-4cf7-a694-eae574288b61 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:48.816055 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-461918b3-b953-4cf7-a694-eae574288b61 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.266616 Dec 16 14:52:48.816609 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 637/1295] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:48 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:49.841659 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-56ddf64a-f400-4b05-ba13-f723ed2a55b2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:49.842402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-56ddf64a-f400-4b05-ba13-f723ed2a55b2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:49.850486 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-56ddf64a-f400-4b05-ba13-f723ed2a55b2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:49.850926 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-56ddf64a-f400-4b05-ba13-f723ed2a55b2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:49.852467 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-56ddf64a-f400-4b05-ba13-f723ed2a55b2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:49.852853 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-56ddf64a-f400-4b05-ba13-f723ed2a55b2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:50.087663 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-56ddf64a-f400-4b05-ba13-f723ed2a55b2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:50.096863 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-56ddf64a-f400-4b05-ba13-f723ed2a55b2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.267230 Dec 16 14:52:50.097374 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 659/1296] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:49 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:51.121129 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-26c6672d-c1c5-4db0-b67f-667288b1c027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:51.121912 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-26c6672d-c1c5-4db0-b67f-667288b1c027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:51.130779 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-26c6672d-c1c5-4db0-b67f-667288b1c027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:51.131211 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-26c6672d-c1c5-4db0-b67f-667288b1c027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:51.132479 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-26c6672d-c1c5-4db0-b67f-667288b1c027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:51.132605 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-26c6672d-c1c5-4db0-b67f-667288b1c027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:51.341066 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-26c6672d-c1c5-4db0-b67f-667288b1c027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:51.349779 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-26c6672d-c1c5-4db0-b67f-667288b1c027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.238985 Dec 16 14:52:51.350398 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 638/1297] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:51 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:52.374752 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f3e0486b-e824-44e0-ba22-c12b104247e2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:52.375373 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f3e0486b-e824-44e0-ba22-c12b104247e2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:52.384339 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3e0486b-e824-44e0-ba22-c12b104247e2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:52.384686 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3e0486b-e824-44e0-ba22-c12b104247e2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:52.385503 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3e0486b-e824-44e0-ba22-c12b104247e2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:52.385939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-f3e0486b-e824-44e0-ba22-c12b104247e2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:52.711901 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f3e0486b-e824-44e0-ba22-c12b104247e2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:52.722294 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f3e0486b-e824-44e0-ba22-c12b104247e2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.357949 Dec 16 14:52:52.723077 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 660/1298] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:52 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:53.746288 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-41a04024-45f9-441b-9047-936be31abc2d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:53.746945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-41a04024-45f9-441b-9047-936be31abc2d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:53.754723 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41a04024-45f9-441b-9047-936be31abc2d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:53.755166 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41a04024-45f9-441b-9047-936be31abc2d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:53.755910 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41a04024-45f9-441b-9047-936be31abc2d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:53.756578 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-41a04024-45f9-441b-9047-936be31abc2d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:54.047898 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-41a04024-45f9-441b-9047-936be31abc2d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:54.057299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-41a04024-45f9-441b-9047-936be31abc2d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.321010 Dec 16 14:52:54.057864 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 639/1299] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:53 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:55.080245 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3d83e246-5dc2-4cde-8e22-218e3fa9fc5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:55.080849 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3d83e246-5dc2-4cde-8e22-218e3fa9fc5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:55.089307 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3d83e246-5dc2-4cde-8e22-218e3fa9fc5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:55.089749 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3d83e246-5dc2-4cde-8e22-218e3fa9fc5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:55.090555 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3d83e246-5dc2-4cde-8e22-218e3fa9fc5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:55.090975 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-3d83e246-5dc2-4cde-8e22-218e3fa9fc5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:55.301348 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3d83e246-5dc2-4cde-8e22-218e3fa9fc5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:55.310904 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3d83e246-5dc2-4cde-8e22-218e3fa9fc5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.239952 Dec 16 14:52:55.311434 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 661/1300] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:55 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:56.334907 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-be654e47-3f6d-404b-a1bb-257a320d3397 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:56.335837 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-be654e47-3f6d-404b-a1bb-257a320d3397 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:56.343125 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be654e47-3f6d-404b-a1bb-257a320d3397 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:56.343564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be654e47-3f6d-404b-a1bb-257a320d3397 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:56.344338 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be654e47-3f6d-404b-a1bb-257a320d3397 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:56.344765 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-be654e47-3f6d-404b-a1bb-257a320d3397 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:56.562244 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-be654e47-3f6d-404b-a1bb-257a320d3397 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:56.571526 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-be654e47-3f6d-404b-a1bb-257a320d3397 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.246636 Dec 16 14:52:56.572112 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 640/1301] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:56 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:57.595085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4d29aaef-bf7c-454d-9fe4-b2a801a67436 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:57.595683 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4d29aaef-bf7c-454d-9fe4-b2a801a67436 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:57.603475 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4d29aaef-bf7c-454d-9fe4-b2a801a67436 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:57.603920 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4d29aaef-bf7c-454d-9fe4-b2a801a67436 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:57.604680 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4d29aaef-bf7c-454d-9fe4-b2a801a67436 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:57.605106 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-4d29aaef-bf7c-454d-9fe4-b2a801a67436 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:57.825800 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4d29aaef-bf7c-454d-9fe4-b2a801a67436 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:57.835109 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4d29aaef-bf7c-454d-9fe4-b2a801a67436 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.249585 Dec 16 14:52:57.835628 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 662/1302] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:57 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:58.218267 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-6ea01227-0533-447b-b7c3-fedfeb5c7e5d req-7fd603ee-7b67-44d1-b77d-a891ef364c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42478ff5-0e4e-4b8a-812b-1c86dcb24306", "name": "network-vif-plugged", "status": "completed", "tag": "080fe726-38f3-4048-85d9-c1b48600093c"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:52:58.225318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:52:58.225318 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:52:58.234312 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-6ea01227-0533-447b-b7c3-fedfeb5c7e5d req-7fd603ee-7b67-44d1-b77d-a891ef364c9b service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:58.234736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-6ea01227-0533-447b-b7c3-fedfeb5c7e5d req-7fd603ee-7b67-44d1-b77d-a891ef364c9b service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:58.251820 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-6ea01227-0533-447b-b7c3-fedfeb5c7e5d req-7fd603ee-7b67-44d1-b77d-a891ef364c9b service nova] Creating event network-vif-plugged:080fe726-38f3-4048-85d9-c1b48600093c for instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 on hv-cinder-82189 Dec 16 14:52:58.257105 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-6ea01227-0533-447b-b7c3-fedfeb5c7e5d req-7fd603ee-7b67-44d1-b77d-a891ef364c9b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049358 Dec 16 14:52:58.257910 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 641/1303] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:52:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:52:58.858687 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e71f977b-f8c1-4617-b330-3b9c8c32ffa8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:58.859309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e71f977b-f8c1-4617-b330-3b9c8c32ffa8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:52:58.867811 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e71f977b-f8c1-4617-b330-3b9c8c32ffa8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:58.868253 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e71f977b-f8c1-4617-b330-3b9c8c32ffa8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:58.869002 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e71f977b-f8c1-4617-b330-3b9c8c32ffa8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:58.869449 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-e71f977b-f8c1-4617-b330-3b9c8c32ffa8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:59.087115 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e71f977b-f8c1-4617-b330-3b9c8c32ffa8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:52:59.095961 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e71f977b-f8c1-4617-b330-3b9c8c32ffa8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1265 microversion: 2.1 time: 0.247161 Dec 16 14:52:59.096540 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 663/1304] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:58 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:53:00.119886 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f12e1b64-e3ce-4f56-80a5-576a45782a3e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:53:00.120603 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f12e1b64-e3ce-4f56-80a5-576a45782a3e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:53:00.128899 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f12e1b64-e3ce-4f56-80a5-576a45782a3e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:53:00.129446 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f12e1b64-e3ce-4f56-80a5-576a45782a3e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:53:00.130564 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f12e1b64-e3ce-4f56-80a5-576a45782a3e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:53:00.130775 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f12e1b64-e3ce-4f56-80a5-576a45782a3e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:53:00.348425 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f12e1b64-e3ce-4f56-80a5-576a45782a3e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:53:00.361067 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f12e1b64-e3ce-4f56-80a5-576a45782a3e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1451 microversion: 2.1 time: 0.251663 Dec 16 14:53:00.361634 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 642/1305] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:53:00 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1451 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:53:00.385360 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fa7d357e-b25f-4e80-8013-7f464ff774b7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:53:00.385951 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fa7d357e-b25f-4e80-8013-7f464ff774b7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:53:00.394221 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fa7d357e-b25f-4e80-8013-7f464ff774b7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:53:00.394670 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fa7d357e-b25f-4e80-8013-7f464ff774b7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:53:00.395561 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fa7d357e-b25f-4e80-8013-7f464ff774b7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:53:00.396334 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fa7d357e-b25f-4e80-8013-7f464ff774b7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:53:00.607607 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-fa7d357e-b25f-4e80-8013-7f464ff774b7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:53:00.616851 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fa7d357e-b25f-4e80-8013-7f464ff774b7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1451 microversion: 2.1 time: 0.242599 Dec 16 14:53:00.617447 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 664/1306] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:53:00 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1451 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:53:03.404857 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-9b1e728d-b9d8-48a8-9d7a-588514c44a18 req-809d7328-3b9d-48ea-a4ed-08d8298841a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42478ff5-0e4e-4b8a-812b-1c86dcb24306", "tag": "080fe726-38f3-4048-85d9-c1b48600093c"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:53:03.414893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:53:03.414893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:53:03.423456 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-9b1e728d-b9d8-48a8-9d7a-588514c44a18 req-809d7328-3b9d-48ea-a4ed-08d8298841a7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:53:03.423971 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-9b1e728d-b9d8-48a8-9d7a-588514c44a18 req-809d7328-3b9d-48ea-a4ed-08d8298841a7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:53:03.441225 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-9b1e728d-b9d8-48a8-9d7a-588514c44a18 req-809d7328-3b9d-48ea-a4ed-08d8298841a7 service nova] Creating event network-changed:080fe726-38f3-4048-85d9-c1b48600093c for instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 on hv-cinder-82189 Dec 16 14:53:03.446679 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-9b1e728d-b9d8-48a8-9d7a-588514c44a18 req-809d7328-3b9d-48ea-a4ed-08d8298841a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056860 Dec 16 14:53:03.447321 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 643/1307] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:53:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:27.464819 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d77e69f-3f23-436f-ac0f-bb2788c9393a] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 14:55:27.475045 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5c426872-ffff-4bf9-afb8-b5f9f49941f4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:27.475622 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5c426872-ffff-4bf9-afb8-b5f9f49941f4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:27.478707 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:55:27.478903 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: Thu Dec 16 14:55:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 (ip 10.222.0.67) !!! Dec 16 14:55:27.488834 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:55:27.489005 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: Thu Dec 16 14:55:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 (ip 10.222.0.67) !!! Dec 16 14:55:27.498842 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:55:27.499011 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: Thu Dec 16 14:55:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 (ip 10.222.0.67) !!! Dec 16 14:55:27.518918 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5c426872-ffff-4bf9-afb8-b5f9f49941f4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:27.519367 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5c426872-ffff-4bf9-afb8-b5f9f49941f4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:27.520153 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5c426872-ffff-4bf9-afb8-b5f9f49941f4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:27.520775 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5c426872-ffff-4bf9-afb8-b5f9f49941f4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:27.592061 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5c426872-ffff-4bf9-afb8-b5f9f49941f4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Going to try to terminate instance {{(pid=96670) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:55:27.859009 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5c426872-ffff-4bf9-afb8-b5f9f49941f4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "DELETE /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 204 len: 0 microversion: 2.1 time: 0.394166 Dec 16 14:55:27.860318 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 665/1308] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:55:27 2021] DELETE /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:55:27.867289 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d120072-e536-428c-9013-c2f8ecacc31c] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:55:27.868123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 14:55:27.868276 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: Thu Dec 16 14:55:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 (ip 10.222.0.67) !!! Dec 16 14:55:27.879055 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:55:27.879222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: Thu Dec 16 14:55:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 (ip 10.222.0.67) !!! Dec 16 14:55:27.890053 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Dec 16 14:55:27.900057 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cf7ae70f-6d0a-4e3e-af1a-7f0ea491a482 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:27.900772 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cf7ae70f-6d0a-4e3e-af1a-7f0ea491a482 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:27.918788 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf7ae70f-6d0a-4e3e-af1a-7f0ea491a482 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:27.919229 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf7ae70f-6d0a-4e3e-af1a-7f0ea491a482 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:27.920017 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf7ae70f-6d0a-4e3e-af1a-7f0ea491a482 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:27.920458 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-cf7ae70f-6d0a-4e3e-af1a-7f0ea491a482 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:28.143673 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cf7ae70f-6d0a-4e3e-af1a-7f0ea491a482 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:28.153223 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cf7ae70f-6d0a-4e3e-af1a-7f0ea491a482 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1575 microversion: 2.1 time: 0.287462 Dec 16 14:55:28.153785 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 644/1309] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:27 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1575 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:29.177876 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2d08f78e-f34a-435d-a027-3966c51cbb14 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:29.178606 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2d08f78e-f34a-435d-a027-3966c51cbb14 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:29.198712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2d08f78e-f34a-435d-a027-3966c51cbb14 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:29.199159 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2d08f78e-f34a-435d-a027-3966c51cbb14 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:29.199936 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2d08f78e-f34a-435d-a027-3966c51cbb14 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:29.200336 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-2d08f78e-f34a-435d-a027-3966c51cbb14 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:29.234668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d77e69f-3f23-436f-ac0f-bb2788c9393a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41146. Dec 16 14:55:29.428586 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2d08f78e-f34a-435d-a027-3966c51cbb14 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:29.437795 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2d08f78e-f34a-435d-a027-3966c51cbb14 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1575 microversion: 2.1 time: 0.270095 Dec 16 14:55:29.438363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 666/1310] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:29 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1575 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:30.461339 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b92191bd-0ebd-4e4f-8c9e-20ac9aa684af tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:30.461942 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b92191bd-0ebd-4e4f-8c9e-20ac9aa684af tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:30.487705 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d120072-e536-428c-9013-c2f8ecacc31c] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41150. Dec 16 14:55:30.489460 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b92191bd-0ebd-4e4f-8c9e-20ac9aa684af tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:30.490087 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b92191bd-0ebd-4e4f-8c9e-20ac9aa684af tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:30.490794 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b92191bd-0ebd-4e4f-8c9e-20ac9aa684af tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:30.491228 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-b92191bd-0ebd-4e4f-8c9e-20ac9aa684af tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:30.953531 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b92191bd-0ebd-4e4f-8c9e-20ac9aa684af tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:30.962552 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b92191bd-0ebd-4e4f-8c9e-20ac9aa684af tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1575 microversion: 2.1 time: 0.510991 Dec 16 14:55:30.963327 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 645/1311] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:30 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1575 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:31.556533 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-06dad165-4930-4914-a0dc-dd5c6d5064bf req-29a278e2-a93b-49ea-85cc-81a6165e6ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42478ff5-0e4e-4b8a-812b-1c86dcb24306", "name": "network-vif-deleted", "tag": "080fe726-38f3-4048-85d9-c1b48600093c"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:55:31.563745 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:55:31.563745 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:55:31.572939 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-06dad165-4930-4914-a0dc-dd5c6d5064bf req-29a278e2-a93b-49ea-85cc-81a6165e6ec7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:31.573723 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-06dad165-4930-4914-a0dc-dd5c6d5064bf req-29a278e2-a93b-49ea-85cc-81a6165e6ec7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:31.593195 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-06dad165-4930-4914-a0dc-dd5c6d5064bf req-29a278e2-a93b-49ea-85cc-81a6165e6ec7 service nova] Creating event network-vif-deleted:080fe726-38f3-4048-85d9-c1b48600093c for instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 on hv-cinder-82189 Dec 16 14:55:31.599903 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-06dad165-4930-4914-a0dc-dd5c6d5064bf req-29a278e2-a93b-49ea-85cc-81a6165e6ec7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053075 Dec 16 14:55:31.600860 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 667/1312] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:55:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:55:31.986150 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-5dea1ad4-eb4b-449f-8f91-3e126a73cdb7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:31.987938 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-5dea1ad4-eb4b-449f-8f91-3e126a73cdb7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:31.996320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5dea1ad4-eb4b-449f-8f91-3e126a73cdb7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:31.996765 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5dea1ad4-eb4b-449f-8f91-3e126a73cdb7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:31.997536 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5dea1ad4-eb4b-449f-8f91-3e126a73cdb7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:31.997948 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-5dea1ad4-eb4b-449f-8f91-3e126a73cdb7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:32.163408 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-5dea1ad4-eb4b-449f-8f91-3e126a73cdb7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:32.172453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-5dea1ad4-eb4b-449f-8f91-3e126a73cdb7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 200 len: 1225 microversion: 2.1 time: 0.195539 Dec 16 14:55:32.182670 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 646/1313] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:31 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 1225 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:33.196830 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9d62bdfb-962d-4f4e-bf93-ffaa0f490f8e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:33.197577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9d62bdfb-962d-4f4e-bf93-ffaa0f490f8e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:33.205617 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9d62bdfb-962d-4f4e-bf93-ffaa0f490f8e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:33.206086 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9d62bdfb-962d-4f4e-bf93-ffaa0f490f8e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:33.206883 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9d62bdfb-962d-4f4e-bf93-ffaa0f490f8e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:33.207363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-9d62bdfb-962d-4f4e-bf93-ffaa0f490f8e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:33.263014 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-9d62bdfb-962d-4f4e-bf93-ffaa0f490f8e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] HTTP exception thrown: Instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 could not be found. Dec 16 14:55:33.263620 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9d62bdfb-962d-4f4e-bf93-ffaa0f490f8e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Returning 404 to user: Instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:55:33.264454 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9d62bdfb-962d-4f4e-bf93-ffaa0f490f8e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 404 len: 111 microversion: 2.1 time: 0.078112 Dec 16 14:55:33.265020 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 668/1314] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:33 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:55:33.329239 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1292232505", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1066298988", "security_groups": [{"name": "tempest-secgroup-smoke-116736629"}], "block_device_mapping_v2": [{"uuid": "303757ef-d860-43f5-862d-ca8329d46ec3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4601ad77-56d7-4b99-978d-819541f9e442"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:55:33.638389 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] validate_networks() for [('4601ad77-56d7-4b99-978d-819541f9e442', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:55:34.187068 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:55:34.187482 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:55:34.187954 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:55:34.188348 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:55:34.188748 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:55:34.199284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:34.199722 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:34.200503 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:34.200924 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:34.219451 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:55:34.224305 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for user 7499170b07074cb2aa9319c0c7a119ee and project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:55:34.331004 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:55:34.333240 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='303757ef-d860-43f5-862d-ca8329d46ec3',volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:55:34.509213 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-2c319d4a-aca4-499c-9384-a64092566dad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.189340 Dec 16 14:55:34.509880 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 647/1315] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:55:33 2021] POST /compute/v2.1/servers => generated 405 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:55:34.529085 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b80295f4-a578-4225-801e-0007fb0b6a21 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:34.529751 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b80295f4-a578-4225-801e-0007fb0b6a21 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:34.615383 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b80295f4-a578-4225-801e-0007fb0b6a21 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:34.623293 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b80295f4-a578-4225-801e-0007fb0b6a21 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1095 microversion: 2.1 time: 0.106006 Dec 16 14:55:34.623856 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 669/1316] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:34 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1095 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:35.648132 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fe2834a8-5a11-4a0f-960e-08eeb9629e2b tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:35.648886 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fe2834a8-5a11-4a0f-960e-08eeb9629e2b tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:35.660622 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fe2834a8-5a11-4a0f-960e-08eeb9629e2b tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:35.661158 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fe2834a8-5a11-4a0f-960e-08eeb9629e2b tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:35.661932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fe2834a8-5a11-4a0f-960e-08eeb9629e2b tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:35.662394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-fe2834a8-5a11-4a0f-960e-08eeb9629e2b tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:35.789048 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fe2834a8-5a11-4a0f-960e-08eeb9629e2b tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:35.797736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fe2834a8-5a11-4a0f-960e-08eeb9629e2b tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1193 microversion: 2.1 time: 0.160759 Dec 16 14:55:35.798316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 648/1317] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:35 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1193 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:36.822025 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5906870b-ff21-4f62-9e9d-2dbb58780bee tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:36.822803 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5906870b-ff21-4f62-9e9d-2dbb58780bee tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:36.831790 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5906870b-ff21-4f62-9e9d-2dbb58780bee tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:36.832309 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5906870b-ff21-4f62-9e9d-2dbb58780bee tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:36.833151 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5906870b-ff21-4f62-9e9d-2dbb58780bee tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:36.833815 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5906870b-ff21-4f62-9e9d-2dbb58780bee tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:37.080236 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5906870b-ff21-4f62-9e9d-2dbb58780bee tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:37.092041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5906870b-ff21-4f62-9e9d-2dbb58780bee tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1278 microversion: 2.1 time: 0.278941 Dec 16 14:55:37.094113 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 670/1318] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:36 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:38.116554 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-9710305e-2124-4f13-89e6-1d568b0ee755 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:38.117930 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-9710305e-2124-4f13-89e6-1d568b0ee755 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:38.126290 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9710305e-2124-4f13-89e6-1d568b0ee755 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:38.126721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9710305e-2124-4f13-89e6-1d568b0ee755 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:38.127495 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9710305e-2124-4f13-89e6-1d568b0ee755 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:38.128101 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-9710305e-2124-4f13-89e6-1d568b0ee755 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:38.170691 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-7219f465-1977-4a08-8d1c-1d3a17a57232 req-907bdd03-212c-4250-b9a4-585c1e4dfea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6403f291-2bd1-45cf-9274-b3a280642563", "tag": "e0779447-afb2-4898-9e47-bb54bef71f59"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:55:38.178846 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:55:38.178846 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:55:38.194755 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-7219f465-1977-4a08-8d1c-1d3a17a57232 req-907bdd03-212c-4250-b9a4-585c1e4dfea7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:38.195210 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-7219f465-1977-4a08-8d1c-1d3a17a57232 req-907bdd03-212c-4250-b9a4-585c1e4dfea7 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:38.214338 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-7219f465-1977-4a08-8d1c-1d3a17a57232 req-907bdd03-212c-4250-b9a4-585c1e4dfea7 service nova] Creating event network-changed:e0779447-afb2-4898-9e47-bb54bef71f59 for instance 6403f291-2bd1-45cf-9274-b3a280642563 on hv-cinder-82189 Dec 16 14:55:38.219841 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-7219f465-1977-4a08-8d1c-1d3a17a57232 req-907bdd03-212c-4250-b9a4-585c1e4dfea7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059203 Dec 16 14:55:38.220634 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 671/1319] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:55:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:38.640465 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-9710305e-2124-4f13-89e6-1d568b0ee755 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:38.649473 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-9710305e-2124-4f13-89e6-1d568b0ee755 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.543007 Dec 16 14:55:38.650123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 649/1320] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:38 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:39.673768 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-df62b551-83eb-4f9b-ae90-71507903feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:39.676495 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-df62b551-83eb-4f9b-ae90-71507903feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:39.686947 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-df62b551-83eb-4f9b-ae90-71507903feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:39.687363 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-df62b551-83eb-4f9b-ae90-71507903feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:39.690945 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-df62b551-83eb-4f9b-ae90-71507903feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:39.691396 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-df62b551-83eb-4f9b-ae90-71507903feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:39.910368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-df62b551-83eb-4f9b-ae90-71507903feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:39.923310 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-df62b551-83eb-4f9b-ae90-71507903feeb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.259096 Dec 16 14:55:39.924044 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 672/1321] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:39 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:40.946676 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-972c0b68-74c4-496a-9b08-3c6e000c73a6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:40.947288 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-972c0b68-74c4-496a-9b08-3c6e000c73a6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:40.956650 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-972c0b68-74c4-496a-9b08-3c6e000c73a6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:40.957103 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-972c0b68-74c4-496a-9b08-3c6e000c73a6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:40.958171 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-972c0b68-74c4-496a-9b08-3c6e000c73a6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:40.958473 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-972c0b68-74c4-496a-9b08-3c6e000c73a6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:41.167604 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-972c0b68-74c4-496a-9b08-3c6e000c73a6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:41.177333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-972c0b68-74c4-496a-9b08-3c6e000c73a6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.240072 Dec 16 14:55:41.177896 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 650/1322] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:40 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:42.200217 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-42ef6d6e-cf2c-48af-9c2f-c44dc28a2104 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:42.200844 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-42ef6d6e-cf2c-48af-9c2f-c44dc28a2104 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:42.209008 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-42ef6d6e-cf2c-48af-9c2f-c44dc28a2104 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:42.209444 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-42ef6d6e-cf2c-48af-9c2f-c44dc28a2104 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:42.210248 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-42ef6d6e-cf2c-48af-9c2f-c44dc28a2104 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:42.210668 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-42ef6d6e-cf2c-48af-9c2f-c44dc28a2104 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:42.444997 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-42ef6d6e-cf2c-48af-9c2f-c44dc28a2104 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:42.456805 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-42ef6d6e-cf2c-48af-9c2f-c44dc28a2104 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.265879 Dec 16 14:55:42.457914 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 673/1323] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:42 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:43.484130 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-1b38aa7c-5236-4b3b-bc30-d6f0ded8fbca tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:43.484919 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-1b38aa7c-5236-4b3b-bc30-d6f0ded8fbca tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:43.492821 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1b38aa7c-5236-4b3b-bc30-d6f0ded8fbca tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:43.493267 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1b38aa7c-5236-4b3b-bc30-d6f0ded8fbca tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:43.494051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1b38aa7c-5236-4b3b-bc30-d6f0ded8fbca tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:43.494471 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-1b38aa7c-5236-4b3b-bc30-d6f0ded8fbca tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:43.716965 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-1b38aa7c-5236-4b3b-bc30-d6f0ded8fbca tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:43.726026 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-1b38aa7c-5236-4b3b-bc30-d6f0ded8fbca tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.251384 Dec 16 14:55:43.726563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 651/1324] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:43 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:44.749107 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fe11be63-16cd-451b-a864-7767edf610c5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:44.749777 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fe11be63-16cd-451b-a864-7767edf610c5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:44.757499 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe11be63-16cd-451b-a864-7767edf610c5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:44.757940 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe11be63-16cd-451b-a864-7767edf610c5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:44.758735 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe11be63-16cd-451b-a864-7767edf610c5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:44.759160 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fe11be63-16cd-451b-a864-7767edf610c5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:44.990993 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-fe11be63-16cd-451b-a864-7767edf610c5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:45.000178 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fe11be63-16cd-451b-a864-7767edf610c5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.260293 Dec 16 14:55:45.000648 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 674/1325] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:44 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:46.024082 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c5c7754e-0b12-4b69-9871-e3b4aadfbb5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:46.025051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c5c7754e-0b12-4b69-9871-e3b4aadfbb5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:46.032911 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c5c7754e-0b12-4b69-9871-e3b4aadfbb5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:46.033360 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c5c7754e-0b12-4b69-9871-e3b4aadfbb5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:46.034284 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c5c7754e-0b12-4b69-9871-e3b4aadfbb5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:46.034702 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-c5c7754e-0b12-4b69-9871-e3b4aadfbb5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:46.249902 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c5c7754e-0b12-4b69-9871-e3b4aadfbb5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:46.258893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c5c7754e-0b12-4b69-9871-e3b4aadfbb5a tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.244529 Dec 16 14:55:46.259463 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 652/1326] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:46 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:47.281787 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fd32d5a0-bbdb-4226-974f-7e40d18aa74e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:47.282614 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fd32d5a0-bbdb-4226-974f-7e40d18aa74e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:47.290788 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fd32d5a0-bbdb-4226-974f-7e40d18aa74e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:47.291239 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fd32d5a0-bbdb-4226-974f-7e40d18aa74e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:47.292027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fd32d5a0-bbdb-4226-974f-7e40d18aa74e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:47.292458 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-fd32d5a0-bbdb-4226-974f-7e40d18aa74e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:47.520530 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-fd32d5a0-bbdb-4226-974f-7e40d18aa74e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:47.529507 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fd32d5a0-bbdb-4226-974f-7e40d18aa74e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.257553 Dec 16 14:55:47.530337 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 675/1327] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:47 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:48.553123 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-343b2f96-3443-449e-99d4-b381ffde3673 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:48.553762 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-343b2f96-3443-449e-99d4-b381ffde3673 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:48.561423 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-343b2f96-3443-449e-99d4-b381ffde3673 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:48.561856 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-343b2f96-3443-449e-99d4-b381ffde3673 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:48.562652 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-343b2f96-3443-449e-99d4-b381ffde3673 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:48.563071 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-343b2f96-3443-449e-99d4-b381ffde3673 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:48.775439 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-343b2f96-3443-449e-99d4-b381ffde3673 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:48.785081 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-343b2f96-3443-449e-99d4-b381ffde3673 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.241063 Dec 16 14:55:48.785613 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 653/1328] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:48 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:49.235614 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-a222c848-654e-4a1b-9c3e-7e9da79efacc req-d11b5991-9c02-4623-9888-58f5c5062830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6403f291-2bd1-45cf-9274-b3a280642563", "name": "network-vif-plugged", "status": "completed", "tag": "e0779447-afb2-4898-9e47-bb54bef71f59"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:55:49.242202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:55:49.242202 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:55:49.250809 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-a222c848-654e-4a1b-9c3e-7e9da79efacc req-d11b5991-9c02-4623-9888-58f5c5062830 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:49.251245 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-a222c848-654e-4a1b-9c3e-7e9da79efacc req-d11b5991-9c02-4623-9888-58f5c5062830 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:49.268013 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-a222c848-654e-4a1b-9c3e-7e9da79efacc req-d11b5991-9c02-4623-9888-58f5c5062830 service nova] Creating event network-vif-plugged:e0779447-afb2-4898-9e47-bb54bef71f59 for instance 6403f291-2bd1-45cf-9274-b3a280642563 on hv-cinder-82189 Dec 16 14:55:49.273341 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-a222c848-654e-4a1b-9c3e-7e9da79efacc req-d11b5991-9c02-4623-9888-58f5c5062830 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130026 Dec 16 14:55:49.274011 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 676/1329] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:55:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:49.807900 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-caf1b7c7-239c-43ce-ba23-10e06a06aad8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:49.808561 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-caf1b7c7-239c-43ce-ba23-10e06a06aad8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:49.816294 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-caf1b7c7-239c-43ce-ba23-10e06a06aad8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:49.816721 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-caf1b7c7-239c-43ce-ba23-10e06a06aad8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:49.817483 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-caf1b7c7-239c-43ce-ba23-10e06a06aad8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:49.817889 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-caf1b7c7-239c-43ce-ba23-10e06a06aad8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:50.127672 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-caf1b7c7-239c-43ce-ba23-10e06a06aad8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:50.137206 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-caf1b7c7-239c-43ce-ba23-10e06a06aad8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1266 microversion: 2.1 time: 0.338448 Dec 16 14:55:50.137773 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 654/1330] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:49 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:51.163125 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-578acdbc-9781-4ba3-a661-9f7f4f1ab859 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:51.164021 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-578acdbc-9781-4ba3-a661-9f7f4f1ab859 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:51.172543 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-578acdbc-9781-4ba3-a661-9f7f4f1ab859 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:51.173013 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-578acdbc-9781-4ba3-a661-9f7f4f1ab859 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:51.173765 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-578acdbc-9781-4ba3-a661-9f7f4f1ab859 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:51.174402 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-578acdbc-9781-4ba3-a661-9f7f4f1ab859 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:51.386746 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-578acdbc-9781-4ba3-a661-9f7f4f1ab859 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:51.395930 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-578acdbc-9781-4ba3-a661-9f7f4f1ab859 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1453 microversion: 2.1 time: 0.243738 Dec 16 14:55:51.396521 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 677/1331] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:51 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1453 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:51.419245 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d28da447-596d-4941-a4bb-6029dba3a4e4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:55:51.419834 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d28da447-596d-4941-a4bb-6029dba3a4e4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:55:51.427550 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d28da447-596d-4941-a4bb-6029dba3a4e4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:51.428002 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d28da447-596d-4941-a4bb-6029dba3a4e4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:51.428813 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d28da447-596d-4941-a4bb-6029dba3a4e4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:51.429237 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d28da447-596d-4941-a4bb-6029dba3a4e4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:51.641879 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d28da447-596d-4941-a4bb-6029dba3a4e4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:55:51.651714 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d28da447-596d-4941-a4bb-6029dba3a4e4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1453 microversion: 2.1 time: 0.242388 Dec 16 14:55:51.652286 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 655/1332] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:51 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1453 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:54.545380 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-e5bab225-e291-4cc2-b1f4-f965d28d0ad2 req-b53cbce4-2032-47f9-9502-3feab64c5fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6403f291-2bd1-45cf-9274-b3a280642563", "tag": "e0779447-afb2-4898-9e47-bb54bef71f59"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:55:54.552496 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:55:54.552496 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:55:54.561232 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-e5bab225-e291-4cc2-b1f4-f965d28d0ad2 req-b53cbce4-2032-47f9-9502-3feab64c5fd9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:55:54.561671 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-e5bab225-e291-4cc2-b1f4-f965d28d0ad2 req-b53cbce4-2032-47f9-9502-3feab64c5fd9 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:55:54.578760 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-e5bab225-e291-4cc2-b1f4-f965d28d0ad2 req-b53cbce4-2032-47f9-9502-3feab64c5fd9 service nova] Creating event network-changed:e0779447-afb2-4898-9e47-bb54bef71f59 for instance 6403f291-2bd1-45cf-9274-b3a280642563 on hv-cinder-82189 Dec 16 14:55:54.584568 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-e5bab225-e291-4cc2-b1f4-f965d28d0ad2 req-b53cbce4-2032-47f9-9502-3feab64c5fd9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127687 Dec 16 14:55:54.585367 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 678/1333] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:55:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:57:57.638101 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1384247681", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1066298988", "security_groups": [{"name": "tempest-secgroup-smoke-116736629"}], "block_device_mapping_v2": [{"uuid": "ad753c53-845d-4915-9ab3-bd40a71ccd98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4601ad77-56d7-4b99-978d-819541f9e442"}]}} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:57:57.665816 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 14:57:57.666225 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: Thu Dec 16 14:57:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.67) !!! Dec 16 14:57:57.914286 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] validate_networks() for [('4601ad77-56d7-4b99-978d-819541f9e442', None, None, None)] {{(pid=96669) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Dec 16 14:57:58.530021 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Flavor limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Dec 16 14:57:58.530541 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Image limits 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Dec 16 14:57:58.531011 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Flavor pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Dec 16 14:57:58.531415 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Image pref 0:0:0 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Dec 16 14:57:58.531820 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.virt.hardware [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Dec 16 14:57:58.540980 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:57:58.541420 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:57:58.542258 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:57:58.542684 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:57:58.560736 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:57:58.564965 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.quota [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Getting quotas for user 7499170b07074cb2aa9319c0c7a119ee and project cc24679d241c4fc5ad847e4dd6d68cc7. Resources: {'ram', 'cores', 'instances'} {{(pid=96669) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:57:58.664219 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Going to run 1 instances... {{(pid=96669) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Dec 16 14:57:58.666331 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad753c53-845d-4915-9ab3-bd40a71ccd98',volume_size=None,volume_type=None)] {{(pid=96669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Dec 16 14:57:58.846584 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-30c3db9e-4136-4008-ac61-ad42c3f99e46 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.218034 Dec 16 14:57:58.847233 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 656/1334] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Dec 16 14:57:57 2021] POST /compute/v2.1/servers => generated 405 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:57:58.855440 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d77e69f-3f23-436f-ac0f-bb2788c9393a] AMQP server on 10.222.0.67:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 16 14:57:58.867385 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-9e793b93-1f7b-4f64-a33b-b933a29d5e77 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:57:58.868099 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-9e793b93-1f7b-4f64-a33b-b933a29d5e77 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:57:59.037420 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-9e793b93-1f7b-4f64-a33b-b933a29d5e77 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:57:59.046205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-9e793b93-1f7b-4f64-a33b-b933a29d5e77 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.192208 Dec 16 14:57:59.046936 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 679/1335] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:57:58 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:00.070730 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-3d4fa080-cb3a-42df-932d-462eff3f44a8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:00.071331 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-3d4fa080-cb3a-42df-932d-462eff3f44a8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:00.159278 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-3d4fa080-cb3a-42df-932d-462eff3f44a8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:00.168913 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-3d4fa080-cb3a-42df-932d-462eff3f44a8 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.107943 Dec 16 14:58:00.169729 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 657/1336] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:00 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:01.192311 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-986b2d37-600a-4779-a77a-237b82360df0 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:01.192922 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-986b2d37-600a-4779-a77a-237b82360df0 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:01.234548 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d77e69f-3f23-436f-ac0f-bb2788c9393a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41332. Dec 16 14:58:01.284270 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-986b2d37-600a-4779-a77a-237b82360df0 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:01.292507 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-986b2d37-600a-4779-a77a-237b82360df0 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.109771 Dec 16 14:58:01.293051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 680/1337] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:01 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:02.317131 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-7122ae12-d45d-4e42-917b-e45bf0275958 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:02.317778 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-7122ae12-d45d-4e42-917b-e45bf0275958 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:02.404704 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-7122ae12-d45d-4e42-917b-e45bf0275958 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:02.413636 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-7122ae12-d45d-4e42-917b-e45bf0275958 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.107888 Dec 16 14:58:02.414143 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 658/1338] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:02 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:03.435992 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-42edf734-4587-40ee-bf29-d200b959130d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:03.436857 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-42edf734-4587-40ee-bf29-d200b959130d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:03.515478 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-42edf734-4587-40ee-bf29-d200b959130d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:03.523511 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-42edf734-4587-40ee-bf29-d200b959130d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.096806 Dec 16 14:58:03.524028 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 681/1339] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:03 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:04.546738 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f48f73f1-1f7b-49a2-915f-1bd4b72e7ed9 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:04.547346 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f48f73f1-1f7b-49a2-915f-1bd4b72e7ed9 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:04.632653 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f48f73f1-1f7b-49a2-915f-1bd4b72e7ed9 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:04.642320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f48f73f1-1f7b-49a2-915f-1bd4b72e7ed9 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.105228 Dec 16 14:58:04.642868 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 659/1340] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:04 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:05.665276 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7fd70804-6ef8-4695-ae1f-d8c25cdb054c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:05.665962 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7fd70804-6ef8-4695-ae1f-d8c25cdb054c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:05.749405 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7fd70804-6ef8-4695-ae1f-d8c25cdb054c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:05.757344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7fd70804-6ef8-4695-ae1f-d8c25cdb054c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.101648 Dec 16 14:58:05.757921 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 682/1341] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:05 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:06.780973 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6ec77a1a-b6dc-483b-9433-19092c8d25e3 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:06.781724 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6ec77a1a-b6dc-483b-9433-19092c8d25e3 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:06.871723 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6ec77a1a-b6dc-483b-9433-19092c8d25e3 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:06.880743 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6ec77a1a-b6dc-483b-9433-19092c8d25e3 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.109089 Dec 16 14:58:06.881304 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 660/1342] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:06 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:07.904656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-913fb07e-87d5-4946-afb2-3e152f57f82f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:07.905289 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-913fb07e-87d5-4946-afb2-3e152f57f82f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:07.983451 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-913fb07e-87d5-4946-afb2-3e152f57f82f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:07.992082 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-913fb07e-87d5-4946-afb2-3e152f57f82f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.096879 Dec 16 14:58:07.992646 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 683/1343] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:07 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:09.016220 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-bd8a9f53-8256-40af-b14c-afd9bd45cd48 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:09.016897 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-bd8a9f53-8256-40af-b14c-afd9bd45cd48 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:09.116054 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-bd8a9f53-8256-40af-b14c-afd9bd45cd48 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:09.127347 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-bd8a9f53-8256-40af-b14c-afd9bd45cd48 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.121633 Dec 16 14:58:09.127909 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 661/1344] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:09 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:10.150763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3bf40033-a285-438f-be11-073e2db8e498 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:10.151397 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3bf40033-a285-438f-be11-073e2db8e498 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:10.229464 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3bf40033-a285-438f-be11-073e2db8e498 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:10.237456 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3bf40033-a285-438f-be11-073e2db8e498 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.096394 Dec 16 14:58:10.238087 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 684/1345] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:10 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:11.260204 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d362ce63-7080-4f05-956e-4f3363d51a9c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:11.260842 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d362ce63-7080-4f05-956e-4f3363d51a9c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:11.339746 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-d362ce63-7080-4f05-956e-4f3363d51a9c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:11.349355 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d362ce63-7080-4f05-956e-4f3363d51a9c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.098490 Dec 16 14:58:11.349925 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 662/1346] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:11 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:12.372618 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-a4210f42-a387-40d4-af33-165da066e042 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:12.373216 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-a4210f42-a387-40d4-af33-165da066e042 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:12.460614 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-a4210f42-a387-40d4-af33-165da066e042 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:12.468180 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-a4210f42-a387-40d4-af33-165da066e042 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.105635 Dec 16 14:58:12.468716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 685/1347] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:12 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:13.492500 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-fb7a2178-6d4f-4284-933b-e6554107aa1e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:13.493125 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-fb7a2178-6d4f-4284-933b-e6554107aa1e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:13.575180 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-fb7a2178-6d4f-4284-933b-e6554107aa1e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:13.583262 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-fb7a2178-6d4f-4284-933b-e6554107aa1e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.101169 Dec 16 14:58:13.583822 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 663/1348] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:13 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:14.606252 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f910ec77-5b64-42e1-a1f9-b9de0f1e586d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:14.606928 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f910ec77-5b64-42e1-a1f9-b9de0f1e586d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:14.685487 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f910ec77-5b64-42e1-a1f9-b9de0f1e586d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:14.694763 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f910ec77-5b64-42e1-a1f9-b9de0f1e586d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.098083 Dec 16 14:58:14.695317 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 686/1349] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:14 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:15.717796 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-da1a1434-a5e3-479d-a16d-22177f828e45 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:15.718467 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-da1a1434-a5e3-479d-a16d-22177f828e45 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:15.798222 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-da1a1434-a5e3-479d-a16d-22177f828e45 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:15.812682 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-da1a1434-a5e3-479d-a16d-22177f828e45 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.104592 Dec 16 14:58:15.813244 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 664/1350] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:15 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:16.835772 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b5e1fc57-7eaf-4382-bc8e-3d7f5d7580f6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:16.836429 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b5e1fc57-7eaf-4382-bc8e-3d7f5d7580f6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:16.914641 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b5e1fc57-7eaf-4382-bc8e-3d7f5d7580f6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:16.922577 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b5e1fc57-7eaf-4382-bc8e-3d7f5d7580f6 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.096294 Dec 16 14:58:16.923117 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 687/1351] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:16 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:17.949051 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-222aa0af-0e71-4468-a0b1-7390a0a304f5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:17.949727 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-222aa0af-0e71-4468-a0b1-7390a0a304f5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:18.032624 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-222aa0af-0e71-4468-a0b1-7390a0a304f5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:18.042556 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-222aa0af-0e71-4468-a0b1-7390a0a304f5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.105870 Dec 16 14:58:18.043268 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 665/1352] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:17 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:19.069809 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-88e64e7d-1aa3-4049-ba16-a397f1f5f027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:19.070589 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-88e64e7d-1aa3-4049-ba16-a397f1f5f027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:19.166480 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-88e64e7d-1aa3-4049-ba16-a397f1f5f027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:19.177531 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-88e64e7d-1aa3-4049-ba16-a397f1f5f027 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.120117 Dec 16 14:58:19.178122 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 688/1353] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:19 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:20.205513 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4da93375-a869-4d83-b202-f6ac89f396ce tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:20.206307 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4da93375-a869-4d83-b202-f6ac89f396ce tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:20.299662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4da93375-a869-4d83-b202-f6ac89f396ce tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:20.307895 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4da93375-a869-4d83-b202-f6ac89f396ce tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.115136 Dec 16 14:58:20.309260 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 666/1354] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:20 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:21.334810 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-1b32d7d5-47e9-417f-bb8d-a00bd39fe85d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:21.335462 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-1b32d7d5-47e9-417f-bb8d-a00bd39fe85d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:21.414285 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-1b32d7d5-47e9-417f-bb8d-a00bd39fe85d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:21.424779 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-1b32d7d5-47e9-417f-bb8d-a00bd39fe85d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.099419 Dec 16 14:58:21.425324 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 689/1355] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:21 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:22.447320 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-cc137b1e-9fa6-4b11-bc4a-ecaee5e073c4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:22.447954 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-cc137b1e-9fa6-4b11-bc4a-ecaee5e073c4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:22.528643 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-cc137b1e-9fa6-4b11-bc4a-ecaee5e073c4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:22.537244 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-cc137b1e-9fa6-4b11-bc4a-ecaee5e073c4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.099313 Dec 16 14:58:22.537814 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 667/1356] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:22 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:23.564332 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-4c04fd62-3de1-402f-a037-253d5143b184 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:23.564958 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-4c04fd62-3de1-402f-a037-253d5143b184 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:23.649433 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-4c04fd62-3de1-402f-a037-253d5143b184 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:23.659087 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-4c04fd62-3de1-402f-a037-253d5143b184 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.106495 Dec 16 14:58:23.659727 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 690/1357] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:23 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:24.685532 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8ad5b268-3581-4bab-8dc5-174a158c8281 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:24.686248 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8ad5b268-3581-4bab-8dc5-174a158c8281 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:24.765529 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-8ad5b268-3581-4bab-8dc5-174a158c8281 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:24.773723 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8ad5b268-3581-4bab-8dc5-174a158c8281 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.098084 Dec 16 14:58:24.774447 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 668/1358] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:24 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:25.797189 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-08379d56-0be7-4a02-83ca-6200e24110c2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:25.797827 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-08379d56-0be7-4a02-83ca-6200e24110c2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:25.879705 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-08379d56-0be7-4a02-83ca-6200e24110c2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:25.888112 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-08379d56-0be7-4a02-83ca-6200e24110c2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.100210 Dec 16 14:58:25.888648 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 691/1359] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:25 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:26.910991 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ebe29144-571c-45ce-8071-3dcdd0e5a9bb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:26.911591 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ebe29144-571c-45ce-8071-3dcdd0e5a9bb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:26.996525 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ebe29144-571c-45ce-8071-3dcdd0e5a9bb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:27.004547 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ebe29144-571c-45ce-8071-3dcdd0e5a9bb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.103103 Dec 16 14:58:27.005091 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 669/1360] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:26 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:28.028603 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-2e84612d-0d23-4b3d-83b9-66f5b4254063 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:28.029342 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-2e84612d-0d23-4b3d-83b9-66f5b4254063 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:28.107984 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-2e84612d-0d23-4b3d-83b9-66f5b4254063 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:28.116440 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-2e84612d-0d23-4b3d-83b9-66f5b4254063 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.097846 Dec 16 14:58:28.126105 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 692/1361] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:28 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:29.140441 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-4ea9cf79-7e9f-4250-baf9-d716b17f07cb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:29.141099 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-4ea9cf79-7e9f-4250-baf9-d716b17f07cb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:29.225572 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-4ea9cf79-7e9f-4250-baf9-d716b17f07cb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:29.234621 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-4ea9cf79-7e9f-4250-baf9-d716b17f07cb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.104770 Dec 16 14:58:29.235195 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 670/1362] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:29 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:30.257700 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-f44dd9e5-4a05-40f2-a057-f61aba3a5fd7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:30.258381 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-f44dd9e5-4a05-40f2-a057-f61aba3a5fd7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:30.339584 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-f44dd9e5-4a05-40f2-a057-f61aba3a5fd7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:30.352571 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-f44dd9e5-4a05-40f2-a057-f61aba3a5fd7 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.104145 Dec 16 14:58:30.353141 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 693/1363] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:30 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:31.367718 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d120072-e536-428c-9013-c2f8ecacc31c] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 14:58:31.377026 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6ea5c0dc-6f95-4bea-af99-9c68d9c32593 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:31.377623 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6ea5c0dc-6f95-4bea-af99-9c68d9c32593 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:31.457459 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6ea5c0dc-6f95-4bea-af99-9c68d9c32593 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:31.466236 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6ea5c0dc-6f95-4bea-af99-9c68d9c32593 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.099718 Dec 16 14:58:31.466833 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 671/1364] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:31 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:32.489350 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-54fe0d32-b37d-4d21-b3c4-02530f0a26da tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:32.489957 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-54fe0d32-b37d-4d21-b3c4-02530f0a26da tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:32.576139 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-54fe0d32-b37d-4d21-b3c4-02530f0a26da tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:32.584136 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-54fe0d32-b37d-4d21-b3c4-02530f0a26da tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.104369 Dec 16 14:58:32.584654 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 694/1365] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:32 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:33.610362 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-ba2fc6b7-f331-45fb-a6ee-71077f867a86 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:33.611076 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-ba2fc6b7-f331-45fb-a6ee-71077f867a86 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:33.651690 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d120072-e536-428c-9013-c2f8ecacc31c] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41400. Dec 16 14:58:33.706444 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-ba2fc6b7-f331-45fb-a6ee-71077f867a86 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:33.714390 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-ba2fc6b7-f331-45fb-a6ee-71077f867a86 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.117185 Dec 16 14:58:33.715059 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 672/1366] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:33 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:34.737137 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ee39c42a-2917-4c66-8bb4-44c7210ad6e5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:34.737785 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ee39c42a-2917-4c66-8bb4-44c7210ad6e5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:34.815490 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ee39c42a-2917-4c66-8bb4-44c7210ad6e5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:34.823783 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ee39c42a-2917-4c66-8bb4-44c7210ad6e5 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.096100 Dec 16 14:58:34.824511 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 695/1367] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:34 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:35.847065 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-c1ea5118-a094-4fae-a3df-c25f58f4218d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:35.847731 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-c1ea5118-a094-4fae-a3df-c25f58f4218d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:35.926379 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-c1ea5118-a094-4fae-a3df-c25f58f4218d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:35.935393 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-c1ea5118-a094-4fae-a3df-c25f58f4218d tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.098255 Dec 16 14:58:35.935945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 673/1368] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:35 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:36.958305 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-e8dad587-d3a5-48c0-84f4-8b83c2ef9d10 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:36.958937 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-e8dad587-d3a5-48c0-84f4-8b83c2ef9d10 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:37.036712 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-e8dad587-d3a5-48c0-84f4-8b83c2ef9d10 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:37.044912 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-e8dad587-d3a5-48c0-84f4-8b83c2ef9d10 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.096099 Dec 16 14:58:37.045474 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 696/1369] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:36 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:38.069039 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-da054e45-0ed6-4cf5-a32f-d2c4f9509fb1 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:38.069662 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-da054e45-0ed6-4cf5-a32f-d2c4f9509fb1 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:38.152921 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-da054e45-0ed6-4cf5-a32f-d2c4f9509fb1 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:38.161658 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-da054e45-0ed6-4cf5-a32f-d2c4f9509fb1 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.103104 Dec 16 14:58:38.162577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 674/1370] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:38 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:39.189318 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cdd0e600-38be-49a1-a18b-3caf308f058e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:39.190475 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cdd0e600-38be-49a1-a18b-3caf308f058e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:39.287191 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cdd0e600-38be-49a1-a18b-3caf308f058e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:39.297368 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cdd0e600-38be-49a1-a18b-3caf308f058e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.122195 Dec 16 14:58:39.297932 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 697/1371] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:39 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:40.320800 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-6173cd06-c750-4a20-a445-d0501a7fba45 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:40.321473 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-6173cd06-c750-4a20-a445-d0501a7fba45 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:40.493972 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-6173cd06-c750-4a20-a445-d0501a7fba45 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:40.502341 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-6173cd06-c750-4a20-a445-d0501a7fba45 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.190902 Dec 16 14:58:40.503159 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 675/1372] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:40 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:41.524694 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-3866f921-523a-4cd0-b190-44e480369354 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:41.525282 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-3866f921-523a-4cd0-b190-44e480369354 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:41.606842 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-3866f921-523a-4cd0-b190-44e480369354 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:41.615556 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-3866f921-523a-4cd0-b190-44e480369354 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.100348 Dec 16 14:58:41.616123 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 698/1373] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:41 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:42.639577 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b1817188-7093-4de0-8cf5-9116f4013299 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:42.640213 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b1817188-7093-4de0-8cf5-9116f4013299 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:42.720312 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b1817188-7093-4de0-8cf5-9116f4013299 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:42.728936 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b1817188-7093-4de0-8cf5-9116f4013299 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.099354 Dec 16 14:58:42.729468 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 676/1374] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:42 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:43.751940 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5f3d6d30-c8c6-47b6-9c13-b080ad6907cd tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:43.752571 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5f3d6d30-c8c6-47b6-9c13-b080ad6907cd tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:43.831112 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-5f3d6d30-c8c6-47b6-9c13-b080ad6907cd tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:43.839140 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5f3d6d30-c8c6-47b6-9c13-b080ad6907cd tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.096944 Dec 16 14:58:43.839719 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 699/1375] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:43 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:44.861961 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-eb69a70b-47b2-41af-833b-13e9ae53d88c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:44.862644 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-eb69a70b-47b2-41af-833b-13e9ae53d88c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:44.940394 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-eb69a70b-47b2-41af-833b-13e9ae53d88c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:44.949160 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-eb69a70b-47b2-41af-833b-13e9ae53d88c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.096047 Dec 16 14:58:44.950299 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 677/1376] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:44 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:45.973401 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-ffdcb06c-d1b4-467f-943e-7a97e801ef8f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:45.974103 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-ffdcb06c-d1b4-467f-943e-7a97e801ef8f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:46.060788 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-ffdcb06c-d1b4-467f-943e-7a97e801ef8f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:46.068870 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-ffdcb06c-d1b4-467f-943e-7a97e801ef8f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.104790 Dec 16 14:58:46.069396 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 700/1377] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:45 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:47.091945 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-b301d515-661b-4e12-b452-b0b498b5dac4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:47.092664 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-b301d515-661b-4e12-b452-b0b498b5dac4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:47.177061 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-b301d515-661b-4e12-b452-b0b498b5dac4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:47.185335 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-b301d515-661b-4e12-b452-b0b498b5dac4 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.102956 Dec 16 14:58:47.185854 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 678/1378] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:47 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:48.209191 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-6d18d9d5-8157-4c0f-8b1d-81d52cf8a1c3 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:48.209828 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-6d18d9d5-8157-4c0f-8b1d-81d52cf8a1c3 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:48.289612 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-6d18d9d5-8157-4c0f-8b1d-81d52cf8a1c3 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:48.299790 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-6d18d9d5-8157-4c0f-8b1d-81d52cf8a1c3 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.101192 Dec 16 14:58:48.300369 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 701/1379] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:48 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:49.322566 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-e63ee360-6d52-42c3-8362-52331b6f3f0f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:49.323200 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-e63ee360-6d52-42c3-8362-52331b6f3f0f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:49.401140 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-e63ee360-6d52-42c3-8362-52331b6f3f0f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:49.410814 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-e63ee360-6d52-42c3-8362-52331b6f3f0f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.097547 Dec 16 14:58:49.411316 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 679/1380] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:49 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:50.433784 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7800f34b-4164-4551-b8aa-6ea98ae1dab0 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:50.434418 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-7800f34b-4164-4551-b8aa-6ea98ae1dab0 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:50.514882 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-7800f34b-4164-4551-b8aa-6ea98ae1dab0 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:50.522914 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7800f34b-4164-4551-b8aa-6ea98ae1dab0 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.098598 Dec 16 14:58:50.523476 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 702/1381] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:50 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:51.546407 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-16512edb-8ba6-4c97-aae2-684bbf27473f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:51.546983 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-16512edb-8ba6-4c97-aae2-684bbf27473f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:51.627469 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-16512edb-8ba6-4c97-aae2-684bbf27473f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:51.636453 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-16512edb-8ba6-4c97-aae2-684bbf27473f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.100146 Dec 16 14:58:51.637047 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 680/1382] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:51 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:52.659703 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-cbfd68b5-71cd-4c4c-abdb-3d3870c8e7ad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:52.660344 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-cbfd68b5-71cd-4c4c-abdb-3d3870c8e7ad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:52.833060 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-cbfd68b5-71cd-4c4c-abdb-3d3870c8e7ad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:52.841722 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-cbfd68b5-71cd-4c4c-abdb-3d3870c8e7ad tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.191796 Dec 16 14:58:52.842303 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 703/1383] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:52 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:53.865058 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-176fda2f-f513-46e3-bfae-9bf003fc1c32 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:53.865742 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-176fda2f-f513-46e3-bfae-9bf003fc1c32 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:53.951303 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-176fda2f-f513-46e3-bfae-9bf003fc1c32 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:53.959070 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-176fda2f-f513-46e3-bfae-9bf003fc1c32 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.103837 Dec 16 14:58:53.959625 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 681/1384] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:53 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:54.981693 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-fb175b67-b5d8-492c-8032-42ea6017012c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:54.983075 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-fb175b67-b5d8-492c-8032-42ea6017012c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:55.062916 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-fb175b67-b5d8-492c-8032-42ea6017012c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:55.073181 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-fb175b67-b5d8-492c-8032-42ea6017012c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.101046 Dec 16 14:58:55.073861 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 704/1385] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:54 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:56.096315 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f74cc1f4-6419-40dd-bad3-ee23ad7f77cb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:56.097628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f74cc1f4-6419-40dd-bad3-ee23ad7f77cb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:56.188450 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-f74cc1f4-6419-40dd-bad3-ee23ad7f77cb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:56.198935 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f74cc1f4-6419-40dd-bad3-ee23ad7f77cb tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.112313 Dec 16 14:58:56.199893 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 682/1386] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:56 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:57.221879 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-d1332e9d-2ef3-4c17-9a7a-f1ec7a69259f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:57.222541 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-d1332e9d-2ef3-4c17-9a7a-f1ec7a69259f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:57.302094 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-d1332e9d-2ef3-4c17-9a7a-f1ec7a69259f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:57.310233 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-d1332e9d-2ef3-4c17-9a7a-f1ec7a69259f tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.097780 Dec 16 14:58:57.310781 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 705/1387] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:57 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:58.332885 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-20e7e68d-10a1-40fb-843a-05ee2f62a6c2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:58.333477 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-20e7e68d-10a1-40fb-843a-05ee2f62a6c2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:58.411998 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-20e7e68d-10a1-40fb-843a-05ee2f62a6c2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:58.420271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-20e7e68d-10a1-40fb-843a-05ee2f62a6c2 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1095 microversion: 2.1 time: 0.096874 Dec 16 14:58:58.420840 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 683/1388] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:58 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:59.443506 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:59.444209 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:59.453584 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:58:59.454027 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:58:59.454838 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:58:59.455274 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:58:59.543656 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:58:59.544097 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:58:59.544545 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lazy-loading 'fault' on Instance uuid 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:58:59.610254 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:58:59.621528 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-51a1bfd0-ac8e-47ff-8d50-3620a5d3f305 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 200 len: 1205 microversion: 2.1 time: 0.187720 Dec 16 14:58:59.622090 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 706/1389] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:58:59 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 1205 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:59.644774 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:58:59.645436 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:58:59.655101 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:58:59.655563 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:58:59.656333 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:58:59.656757 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:58:59.730198 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:58:59.823794 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=96669) _delete /opt/stack/nova/nova/compute/api.py:2384}} Dec 16 14:58:59.824676 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:58:59.825114 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:58:59.825785 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: WARNING nova.compute.api [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] instance's host None is down, deleting from database Dec 16 14:58:59.829314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [499edd65-cde6-4b1c-8c90-f1fcc2a397f5] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:59:00.847421 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [499edd65-cde6-4b1c-8c90-f1fcc2a397f5] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41456. Dec 16 14:59:00.853018 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] deallocate_for_instance() {{(pid=96669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1651}} Dec 16 14:59:00.899197 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Instance cache missing network info. {{(pid=96669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:2995}} Dec 16 14:59:00.906232 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.network.neutron [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Updating instance_info_cache with network_info: [] {{(pid=96669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Dec 16 14:59:01.305241 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.scheduler.client.report [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Cannot delete allocation for 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f consumer in placement as consumer does not exist {{(pid=96669) delete_allocation_for_instance /opt/stack/nova/nova/scheduler/client/report.py:2015}} Dec 16 14:59:01.506342 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d0454c11-3df9-4bf7-9800-449032d589de tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 204 len: 0 microversion: 2.1 time: 1.872051 Dec 16 14:59:01.506873 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 684/1390] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:58:59 2021] DELETE /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 0 bytes in 1873 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:59:01.521581 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c8146dcd-23f9-4878-9bf6-1eafbf8d9953 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:01.522226 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-c8146dcd-23f9-4878-9bf6-1eafbf8d9953 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:59:01.531412 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8146dcd-23f9-4878-9bf6-1eafbf8d9953 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:01.531848 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8146dcd-23f9-4878-9bf6-1eafbf8d9953 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:01.532616 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8146dcd-23f9-4878-9bf6-1eafbf8d9953 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:01.533041 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-c8146dcd-23f9-4878-9bf6-1eafbf8d9953 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:01.582659 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-c8146dcd-23f9-4878-9bf6-1eafbf8d9953 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] HTTP exception thrown: Instance 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f could not be found. Dec 16 14:59:01.583295 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-c8146dcd-23f9-4878-9bf6-1eafbf8d9953 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Returning 404 to user: Instance 3e2c22de-dfa3-4ad2-93ca-0669a355bd1f could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:59:01.584129 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-c8146dcd-23f9-4878-9bf6-1eafbf8d9953 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f" status: 404 len: 111 microversion: 2.1 time: 0.072191 Dec 16 14:59:01.584699 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 707/1391] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:59:01 2021] GET /compute/v2.1/servers/3e2c22de-dfa3-4ad2-93ca-0669a355bd1f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:59:05.656552 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [req-05b8a745-9e14-42ab-8d0f-4b63ec51c8b0 req-97d6576f-bb41-4e8c-84a2-587d66f64d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6403f291-2bd1-45cf-9274-b3a280642563", "tag": "e0779447-afb2-4898-9e47-bb54bef71f59"}]} {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:59:05.658492 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:05.659127 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:59:05.664174 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:59:05.664174 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: warnings.warn(msg) Dec 16 14:59:05.667901 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:05.668503 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:05.669936 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:05.670270 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:05.683442 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-05b8a745-9e14-42ab-8d0f-4b63ec51c8b0 req-97d6576f-bb41-4e8c-84a2-587d66f64d36 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:05.683926 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [req-05b8a745-9e14-42ab-8d0f-4b63ec51c8b0 req-97d6576f-bb41-4e8c-84a2-587d66f64d36 service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:05.706561 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.compute.server_external_events [req-05b8a745-9e14-42ab-8d0f-4b63ec51c8b0 req-97d6576f-bb41-4e8c-84a2-587d66f64d36 service nova] Creating event network-changed:e0779447-afb2-4898-9e47-bb54bef71f59 for instance 6403f291-2bd1-45cf-9274-b3a280642563 on hv-cinder-82189 Dec 16 14:59:05.709320 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: ERROR oslo.messaging._drivers.impl_rabbit [req-05b8a745-9e14-42ab-8d0f-4b63ec51c8b0 req-97d6576f-bb41-4e8c-84a2-587d66f64d36 service nova] [923d6ff4-6ec2-4ecc-8d43-37c81909458a] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:59:05.748628 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Going to try to terminate instance {{(pid=96669) delete /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 14:59:05.889663 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [624fc1de-fc1a-494b-bd61-d69201ed8690] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:59:06.728293 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [req-05b8a745-9e14-42ab-8d0f-4b63ec51c8b0 req-97d6576f-bb41-4e8c-84a2-587d66f64d36 service nova] [923d6ff4-6ec2-4ecc-8d43-37c81909458a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41492. Dec 16 14:59:06.732302 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [req-05b8a745-9e14-42ab-8d0f-4b63ec51c8b0 req-97d6576f-bb41-4e8c-84a2-587d66f64d36 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.086975 Dec 16 14:59:06.732896 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 708/1392] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:59:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:59:06.907614 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO oslo.messaging._drivers.impl_rabbit [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [624fc1de-fc1a-494b-bd61-d69201ed8690] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41494. Dec 16 14:59:06.938097 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-8ddeb786-acd0-4837-ac6e-4777bb45693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 204 len: 0 microversion: 2.1 time: 1.291852 Dec 16 14:59:06.939354 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 685/1393] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:59:05 2021] DELETE /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 0 bytes in 1295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:59:06.954679 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-762fcf2f-30f6-4737-8254-262ea390c78e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:06.955588 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-762fcf2f-30f6-4737-8254-262ea390c78e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:59:06.964136 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-762fcf2f-30f6-4737-8254-262ea390c78e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:06.964756 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-762fcf2f-30f6-4737-8254-262ea390c78e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:06.965711 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-762fcf2f-30f6-4737-8254-262ea390c78e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:06.966422 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-762fcf2f-30f6-4737-8254-262ea390c78e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:07.210051 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-762fcf2f-30f6-4737-8254-262ea390c78e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:59:07.219014 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-762fcf2f-30f6-4737-8254-262ea390c78e tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1578 microversion: 2.1 time: 0.274870 Dec 16 14:59:07.219545 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 709/1394] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:59:06 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1578 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:08.248887 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-84a4579a-627e-45c9-a044-3c38bd9fb472 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:08.249576 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-84a4579a-627e-45c9-a044-3c38bd9fb472 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:59:08.257982 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-84a4579a-627e-45c9-a044-3c38bd9fb472 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:08.258465 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-84a4579a-627e-45c9-a044-3c38bd9fb472 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:08.259271 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-84a4579a-627e-45c9-a044-3c38bd9fb472 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:08.260032 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-84a4579a-627e-45c9-a044-3c38bd9fb472 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:08.475192 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.policy [None req-84a4579a-627e-45c9-a044-3c38bd9fb472 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96669) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:59:08.485207 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-84a4579a-627e-45c9-a044-3c38bd9fb472 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1459 microversion: 2.1 time: 0.246472 Dec 16 14:59:08.485826 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 686/1395] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:59:08 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1459 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:09.509204 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-b95244ea-d5ec-4207-acd4-05561410693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:09.510213 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-b95244ea-d5ec-4207-acd4-05561410693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:59:09.520245 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b95244ea-d5ec-4207-acd4-05561410693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:09.520815 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b95244ea-d5ec-4207-acd4-05561410693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:09.521734 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b95244ea-d5ec-4207-acd4-05561410693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:09.522208 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-b95244ea-d5ec-4207-acd4-05561410693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:09.774976 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-b95244ea-d5ec-4207-acd4-05561410693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:59:09.787537 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-b95244ea-d5ec-4207-acd4-05561410693c tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1459 microversion: 2.1 time: 0.288278 Dec 16 14:59:09.798090 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 710/1396] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:59:09 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1459 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:09.962309 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [req-a42d2eea-b157-46b5-9afb-6a532996b1e0 req-098cce10-0d18-4325-805b-d948bb7add3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6403f291-2bd1-45cf-9274-b3a280642563", "name": "network-vif-deleted", "tag": "e0779447-afb2-4898-9e47-bb54bef71f59"}]} {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:59:09.969831 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:59:09.969831 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: warnings.warn(msg) Dec 16 14:59:09.980337 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-a42d2eea-b157-46b5-9afb-6a532996b1e0 req-098cce10-0d18-4325-805b-d948bb7add3e service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:09.980794 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [req-a42d2eea-b157-46b5-9afb-6a532996b1e0 req-098cce10-0d18-4325-805b-d948bb7add3e service nova] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:09.999044 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.compute.server_external_events [req-a42d2eea-b157-46b5-9afb-6a532996b1e0 req-098cce10-0d18-4325-805b-d948bb7add3e service nova] Creating event network-vif-deleted:e0779447-afb2-4898-9e47-bb54bef71f59 for instance 6403f291-2bd1-45cf-9274-b3a280642563 on hv-cinder-82189 Dec 16 14:59:10.004550 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [req-a42d2eea-b157-46b5-9afb-6a532996b1e0 req-098cce10-0d18-4325-805b-d948bb7add3e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155925 Dec 16 14:59:10.005376 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 687/1397] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Dec 16 14:59:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:59:10.812335 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:10.812992 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:59:10.821155 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:10.821685 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:10.822432 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:10.822909 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:10.901240 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:10.901680 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:10.902361 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.objects.instance [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lazy-loading 'fault' on Instance uuid 6403f291-2bd1-45cf-9274-b3a280642563 {{(pid=96670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:59:10.967983 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.policy [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7499170b07074cb2aa9319c0c7a119ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96670) authorize /opt/stack/nova/nova/policy.py:222}} Dec 16 14:59:10.977228 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-545bea8c-b568-4bdf-bc88-5b72365c3203 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 200 len: 1185 microversion: 2.1 time: 0.175351 Dec 16 14:59:10.977790 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 711/1398] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:59:10 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 1185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:12.003314 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f2705d0d-10db-494a-8e69-e0316a6a1823 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:12.003990 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-f2705d0d-10db-494a-8e69-e0316a6a1823 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 6403f291-2bd1-45cf-9274-b3a280642563] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:59:12.012932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f2705d0d-10db-494a-8e69-e0316a6a1823 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:12.013402 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f2705d0d-10db-494a-8e69-e0316a6a1823 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:12.014263 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f2705d0d-10db-494a-8e69-e0316a6a1823 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:12.014697 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-f2705d0d-10db-494a-8e69-e0316a6a1823 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:12.069730 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-f2705d0d-10db-494a-8e69-e0316a6a1823 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] HTTP exception thrown: Instance 6403f291-2bd1-45cf-9274-b3a280642563 could not be found. Dec 16 14:59:12.070258 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-f2705d0d-10db-494a-8e69-e0316a6a1823 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Returning 404 to user: Instance 6403f291-2bd1-45cf-9274-b3a280642563 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:59:12.071126 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-f2705d0d-10db-494a-8e69-e0316a6a1823 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563" status: 404 len: 111 microversion: 2.1 time: 0.078630 Dec 16 14:59:12.071690 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 688/1399] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:59:11 2021] GET /compute/v2.1/servers/6403f291-2bd1-45cf-9274-b3a280642563 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:59:12.929205 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5f7e0646-c740-4a92-a202-a01ddbfaa9ff tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:12.929934 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.compute.api [None req-5f7e0646-c740-4a92-a202-a01ddbfaa9ff tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96670) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:59:12.937693 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f7e0646-c740-4a92-a202-a01ddbfaa9ff tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:12.938163 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f7e0646-c740-4a92-a202-a01ddbfaa9ff tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:12.939575 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f7e0646-c740-4a92-a202-a01ddbfaa9ff tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:12.940002 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG oslo_concurrency.lockutils [None req-5f7e0646-c740-4a92-a202-a01ddbfaa9ff tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:12.994723 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.wsgi [None req-5f7e0646-c740-4a92-a202-a01ddbfaa9ff tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] HTTP exception thrown: Instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 could not be found. Dec 16 14:59:12.995201 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-5f7e0646-c740-4a92-a202-a01ddbfaa9ff tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Returning 404 to user: Instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 could not be found. {{(pid=96670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:59:12.996110 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-5f7e0646-c740-4a92-a202-a01ddbfaa9ff tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "DELETE /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 404 len: 111 microversion: 2.1 time: 0.077492 Dec 16 14:59:12.996716 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 712/1400] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Dec 16 14:59:12 2021] DELETE /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:59:13.018932 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d89d9eb7-134f-41a4-8c62-4eda2e84a423 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '>' {{(pid=96669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:13.019574 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.compute.api [None req-d89d9eb7-134f-41a4-8c62-4eda2e84a423 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [instance: 42478ff5-0e4e-4b8a-812b-1c86dcb24306] Fetching instance by UUID {{(pid=96669) get /opt/stack/nova/nova/compute/api.py:2810}} Dec 16 14:59:13.027759 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d89d9eb7-134f-41a4-8c62-4eda2e84a423 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:13.028217 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d89d9eb7-134f-41a4-8c62-4eda2e84a423 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:13.029004 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d89d9eb7-134f-41a4-8c62-4eda2e84a423 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:59:13.029423 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG oslo_concurrency.lockutils [None req-d89d9eb7-134f-41a4-8c62-4eda2e84a423 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Lock "3d4c520e-4808-4be1-897a-302246289de2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:59:13.084927 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.wsgi [None req-d89d9eb7-134f-41a4-8c62-4eda2e84a423 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] HTTP exception thrown: Instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 could not be found. Dec 16 14:59:13.085575 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: DEBUG nova.api.openstack.wsgi [None req-d89d9eb7-134f-41a4-8c62-4eda2e84a423 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Returning 404 to user: Instance 42478ff5-0e4e-4b8a-812b-1c86dcb24306 could not be found. {{(pid=96669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Dec 16 14:59:13.086448 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: INFO nova.api.openstack.requestlog [None req-d89d9eb7-134f-41a4-8c62-4eda2e84a423 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306" status: 404 len: 111 microversion: 2.1 time: 0.082539 Dec 16 14:59:13.087060 dv-cinder-821893-3-iscsi devstack@n-api.service[96669]: [pid: 96669|app: 0|req: 689/1401] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Dec 16 14:59:13 2021] GET /compute/v2.1/servers/42478ff5-0e4e-4b8a-812b-1c86dcb24306 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:59:14.630733 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: DEBUG nova.api.openstack.wsgi [None req-7e624bb2-38c5-4f39-916a-54a550686081 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] Calling method '.version_select at 0x7f26fe7b83a0>' {{(pid=96670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:59:14.642287 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7e624bb2-38c5-4f39-916a-54a550686081 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [f72844bb-4cc9-4499-be44-29d9113ebc57] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:59:15.659902 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO oslo.messaging._drivers.impl_rabbit [None req-7e624bb2-38c5-4f39-916a-54a550686081 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] [f72844bb-4cc9-4499-be44-29d9113ebc57] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41530. Dec 16 14:59:15.681165 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: INFO nova.api.openstack.requestlog [None req-7e624bb2-38c5-4f39-916a-54a550686081 tempest-TestVolumeBootPattern-751522082 tempest-TestVolumeBootPattern-751522082-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1066298988" status: 202 len: 0 microversion: 2.1 time: 1.067344 Dec 16 14:59:15.681822 dv-cinder-821893-3-iscsi devstack@n-api.service[96670]: [pid: 96670|app: 0|req: 713/1402] 10.222.0.67 () {58 vars in 1262 bytes} [Thu Dec 16 14:59:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1066298988 => generated 0 bytes in 1069 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)